2026-03-19 Thu 05:36:02:554.652 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: http-server-port 8091
2026-03-19 Thu 05:36:02:554.764 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Max-tasks 16
2026-03-19 Thu 05:36:02:554.773 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Max-slice 100
2026-03-19 Thu 05:36:02:554.779 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Collectors  10.0.0.38:8086
2026-03-19 Thu 05:36:02:554.784 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Collectors  10.0.0.50:8086
2026-03-19 Thu 05:36:02:554.789 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Collectors  10.0.0.33:8086
2026-03-19 Thu 05:36:02:554.810 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: ROLE             : Generator
2026-03-19 Thu 05:36:02:554.816 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2026-03-19 Thu 05:36:02:554.822 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-5495-2.
2026-03-19 Thu 05:36:02:554.827 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: NODE TYPE        : Database
2026-03-19 Thu 05:36:02:554.833 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: INSTANCE ID      : 0
2026-03-19 Thu 05:36:02:554.838 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2026-03-19 Thu 05:36:02:554.844 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2026-03-19 Thu 05:36:02:558.163 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: HTTP Introspect Init
2026-03-19 Thu 05:36:02:558.299 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2026-03-19 Thu 05:36:02:558.377 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Sandesh Http Server Port: 8091
2026-03-19 Thu 05:36:02:558.419 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2026-03-19 Thu 05:36:02:558.428 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2026-03-19 Thu 05:36:02:558.506 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Idle
2026-03-19 Thu 05:36:02:558.669 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: No Client: 1773898562558594  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:02:558.829 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2026-03-19 Thu 05:36:02:558.844 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2026-03-19 Thu 05:36:02:558.856 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 
2026-03-19 Thu 05:36:02:559.001 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvStart in state Idle
2026-03-19 Thu 05:36:02:559.073 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Disconnect
2026-03-19 Thu 05:36:02:559.145 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2026-03-19 Thu 05:36:02:559.358 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:36:02:559.434 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:559.457 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SANDESH: Send FAILED: 1773898562559065  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:36:02:559.466 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:02:559.474 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:559.552 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SANDESH: Send FAILED: 1773898562559134  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:02:559.569 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:02:559.579 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:559.647 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SANDESH: Send FAILED: 1773898562559192  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:02:559.663 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:02:559.672 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:559.687 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SANDESH: Send FAILED: 1773898562559213  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:36:02:559.694 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:02:559.701 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:559.774 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SANDESH: Send FAILED: 1773898562559415  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:02:559.787 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:02:587.320 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2026-03-19 Thu 05:36:02:587.367 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:02:587.439 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:02:587.494 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803741329152, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:02:587.525 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803741329152, Pid 1]: SANDESH: Send FAILED: 1773898562587407  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:36:02:587.535 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803741329152, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:07:590.762 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2026-03-19 Thu 05:36:07:590.813 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:07:590.864 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:12:592.947 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2026-03-19 Thu 05:36:12:593.056 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:12:593.079 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:17:595.362 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2026-03-19 Thu 05:36:17:595.409 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:17:595.431 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:22:720.528 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2026-03-19 Thu 05:36:22:720.583 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:22:720.609 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:27:912.267 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2026-03-19 Thu 05:36:27:912.318 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:27:912.350 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:32:975.022 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2026-03-19 Thu 05:36:32:975.076 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:32:975.099 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:38:037.365 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2026-03-19 Thu 05:36:38:037.432 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2026-03-19 Thu 05:36:43:063.576 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2026-03-19 Thu 05:36:48:071.032 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:48:071.089 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:36:48:071.145 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:36:48:071.172 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3f1a0
2026-03-19 Thu 05:36:48:071.181 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:071.114 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608070896  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:36:48:071.232 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:48:071.249 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:36:48:071.258 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:36:48:071.436 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:36:48:071.501 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Idle
2026-03-19 Thu 05:36:48:071.570 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:071.685 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608071360  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 26,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:48:071.727 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:48:071.739 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:071.764 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608071399  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:36:48:071.785 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:48:071.215 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:071.797 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:36:48:071.831 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3fae0
2026-03-19 Thu 05:36:48:071.898 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:071.911 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:071.924 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b40420
2026-03-19 Thu 05:36:48:071.930 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:071.942 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:071.942 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:071.997 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b40d60
2026-03-19 Thu 05:36:48:072.011 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.027 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.039 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b416a0
2026-03-19 Thu 05:36:48:072.046 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.057 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.068 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3d5f0
2026-03-19 Thu 05:36:48:072.073 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.078 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608071561  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 27,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:48:072.082 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.106 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:48:072.127 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3dca0
2026-03-19 Thu 05:36:48:072.143 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.153 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.172 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3e340
2026-03-19 Thu 05:36:48:072.178 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.186 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.196 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b3e870
2026-03-19 Thu 05:36:48:072.202 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.210 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.219 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b371d0
2026-03-19 Thu 05:36:48:072.224 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.232 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.242 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b41fe0
2026-03-19 Thu 05:36:48:072.247 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.255 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.265 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b42920
2026-03-19 Thu 05:36:48:072.270 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.278 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.287 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b43260
2026-03-19 Thu 05:36:48:072.292 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.300 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.309 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b43ba0
2026-03-19 Thu 05:36:48:072.317 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.325 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.337 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: RAC_Connect status: 0 0x2b444e0
2026-03-19 Thu 05:36:48:072.345 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:36:48:072.356 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:36:48:072.496 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:072.543 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608072412  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773898608071499 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773898608071933 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:36:48:072.552 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:48:072.561 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:072.660 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608072479  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:48:072.675 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:48:072.970 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.007 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.130 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:073.187 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803800106752, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:073.275 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803800106752, Pid 1]: SANDESH: Send FAILED: 1773898608073102  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:36:48:073.289 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803800106752, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:48:073.190 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.481 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.499 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.509 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.523 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.533 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.546 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.555 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.569 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.578 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.593 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:073.602 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:073.663 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:073.683 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:073.713 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:073.730 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:073.735 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803762321152, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:073.797 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803762321152, Pid 1]: SANDESH: Send FAILED: 1773898608073641  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:36:48:073.812 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803762321152, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:48:073.758 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.020 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.040 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.058 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.072 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.081 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.095 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.104 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.122 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.132 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.144 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.154 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.167 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.176 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.189 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.198 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.211 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:36:48:074.220 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:36:48:074.260 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.283 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.307 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.331 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.039 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:074.359 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.400 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608074002  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:36:48:074.427 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:48:074.400 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.477 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.448 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:36:48:074.508 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:36:48:074.514 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898608074350  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:36:48:074.545 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:49:071.677 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:36:49:071.973 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086
2026-03-19 Thu 05:36:49:072.077 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:49:072.107 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898609071786  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:36:49:072.127 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:36:49:072.137 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:36:49:072.253 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898609072060  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:49:072.269 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:36:49:074.432 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:47216::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:36:49:074.464 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: 10.0.0.50:47216::10.0.0.33:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:36:49:074.477 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: 10.0.0.50:47216::10.0.0.33:8086(-1):EvTcpConnected
2026-03-19 Thu 05:36:49:074.552 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:36:49:074.573 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:36:49:074.608 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: ClientInit
2026-03-19 Thu 05:36:49:074.628 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 1
2026-03-19 Thu 05:36:49:074.727 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:36:49:074.742 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:36:49:074.771 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898609074600  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:36:49:074.782 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:36:49:074.803 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:36:49:074.812 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:36:49:074.827 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:36:49:074.836 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:36:49:074.973 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: SANDESH: Send FAILED: 1773898609074714  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:36:49:074.991 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803770717952, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:36:49:080.092 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: OnMessage control in state: ClientInit
2026-03-19 Thu 05:36:49:080.191 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2026-03-19 Thu 05:36:49:080.204 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: ClientInit : EvSandeshMessageRecv
2026-03-19 Thu 05:36:49:080.230 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Received Ctrl Message with size 0
2026-03-19 Thu 05:36:49:080.402 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773898608071499 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773898608071933 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2026-03-19 Thu 05:36:49:080.429 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:36:49:080.472 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2026-03-19 Thu 05:36:49:080.492 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:36:49:080.503 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:36:49:080.513 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:36:49:080.567 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Established
2026-03-19 Thu 05:36:57:428.674 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: OnMessage control in state: Established
2026-03-19 Thu 05:36:57:428.755 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2026-03-19 Thu 05:36:57:428.766 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: Established : EvSandeshMessageRecv
2026-03-19 Thu 05:36:57:428.814 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: Received Ctrl Message with size 3
2026-03-19 Thu 05:36:57:428.832 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2026-03-19 Thu 05:36:57:428.847 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2026-03-19 Thu 05:36:57:428.863 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2026-03-19 Thu 05:36:57:428.875 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803779114752, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:37:18:072.832 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2026-03-19 Thu 05:38:18:073.685 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803787511552, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2026-03-19 Thu 05:39:18:074.432 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803800106752, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2026-03-19 Thu 05:40:18:075.118 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2026-03-19 Thu 05:41:04:060.967 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:38166 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2026-03-19 Thu 05:41:18:075.626 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803804305152, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2026-03-19 Thu 05:41:18:568.249 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803947976832, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:37650 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2026-03-19 Thu 05:42:18:081.146 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803749725952, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0
2026-03-19 Thu 05:43:18:082.234 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803783313152, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0
2026-03-19 Thu 05:43:24:966.555 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Processing scm::EvStop in state Established
2026-03-19 Thu 05:43:24:966.646 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Idle
2026-03-19 Thu 05:43:24:966.762 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:43:24:966.773 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:43:24:966.928 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: SANDESH: Send FAILED: 1773899004966748  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773898562558516 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 353987 calls = 38 average_bytes = 9315 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 28 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 89,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20,  _iter59->first = sent _iter59->second = 39,  ] ] ]
2026-03-19 Thu 05:43:24:966.965 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139803774916352, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:43:38:099.433 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: http-server-port 8091
2026-03-19 Thu 05:43:38:099.524 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Max-tasks 16
2026-03-19 Thu 05:43:38:099.539 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Max-slice 100
2026-03-19 Thu 05:43:38:099.546 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Collectors  10.0.0.38:8086
2026-03-19 Thu 05:43:38:099.551 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Collectors  10.0.0.50:8086
2026-03-19 Thu 05:43:38:099.559 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Collectors  10.0.0.33:8086
2026-03-19 Thu 05:43:38:099.580 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: ROLE             : Generator
2026-03-19 Thu 05:43:38:099.586 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2026-03-19 Thu 05:43:38:099.591 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-5495-2.
2026-03-19 Thu 05:43:38:099.596 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: NODE TYPE        : Database
2026-03-19 Thu 05:43:38:099.602 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: INSTANCE ID      : 0
2026-03-19 Thu 05:43:38:099.607 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2026-03-19 Thu 05:43:38:099.613 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2026-03-19 Thu 05:43:38:101.465 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: HTTP Introspect Init
2026-03-19 Thu 05:43:38:101.691 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2026-03-19 Thu 05:43:38:101.783 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Sandesh Http Server Port: 8091
2026-03-19 Thu 05:43:38:101.988 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2026-03-19 Thu 05:43:38:102.003 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2026-03-19 Thu 05:43:38:102.105 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Idle
2026-03-19 Thu 05:43:38:102.385 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: No Client: 1773899018102297  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:43:38:102.624 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2026-03-19 Thu 05:43:38:102.643 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2026-03-19 Thu 05:43:38:102.661 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 
2026-03-19 Thu 05:43:38:102.765 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvStart in state Idle
2026-03-19 Thu 05:43:38:107.043 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Disconnect
2026-03-19 Thu 05:43:38:107.161 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2026-03-19 Thu 05:43:38:107.418 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2026-03-19 Thu 05:43:38:107.489 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:43:38:107.511 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899018107012  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:43:38:107.521 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:43:38:107.531 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:43:38:107.622 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899018107148  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:43:38:107.640 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:43:38:107.649 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:43:38:107.732 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899018107211  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:43:38:107.745 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:43:38:107.754 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:43:38:107.774 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899018107234  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:43:38:107.781 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:43:38:107.789 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:43:38:107.860 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899018107477  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:43:38:107.872 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:43:38:196.153 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2026-03-19 Thu 05:44:14:264.398 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:44:14:264.480 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899054264309  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:44:14:264.490 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:44:14:264.492 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:14:264.535 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:44:14:264.580 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12961a0
2026-03-19 Thu 05:44:14:264.588 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.612 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.630 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1296ae0
2026-03-19 Thu 05:44:14:264.638 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.650 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.674 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1297420
2026-03-19 Thu 05:44:14:264.682 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.693 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.716 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1297d60
2026-03-19 Thu 05:44:14:264.724 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.734 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.745 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12986a0
2026-03-19 Thu 05:44:14:264.752 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.763 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.775 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12945f0
2026-03-19 Thu 05:44:14:264.782 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.793 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.804 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1294ca0
2026-03-19 Thu 05:44:14:264.811 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.822 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.833 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1295340
2026-03-19 Thu 05:44:14:264.839 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.851 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.873 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1295870
2026-03-19 Thu 05:44:14:264.881 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:264.892 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:264.914 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:44:14:264.962 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:44:14:264.988 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:44:14:265.010 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:44:14:264.988 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:44:14:265.027 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x128e1d0
2026-03-19 Thu 05:44:14:265.074 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:14:265.087 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:14:265.067 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:44:14:265.137 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:44:14:265.251 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:44:14:265.298 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Idle
2026-03-19 Thu 05:44:14:265.372 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:265.497 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899054265192  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 12,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:44:14:265.524 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:44:14:265.539 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:265.567 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899054265225  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:44:14:265.578 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:14:265.590 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:44:14:265.634 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:265.750 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899054265360  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 13,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:44:14:265.767 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:44:14:265.860 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:265.912 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899054265793  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899054265296 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899054265632 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:44:14:265.920 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:44:14:265.928 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:266.032 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899054265847  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 14,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:44:14:266.052 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:44:14:265.376 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.437 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.514 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:266.532 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:266.538 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.581 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.608 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.617 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.631 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.640 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.652 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.675 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.688 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.697 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.724 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.734 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.747 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.756 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.769 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.778 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.790 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:14:266.799 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:14:266.833 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:266.588 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899054266485  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:44:14:266.866 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:266.871 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:14:266.894 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:266.896 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:266.918 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:266.934 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899054266825  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:44:14:266.943 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:14:266.960 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:267.016 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:267.037 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:267.051 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:267.065 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:14:267.020 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:44:14:267.560 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899054266996  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:44:14:267.572 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:15:265.425 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:44:15:265.876 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:44:15:265.987 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:44:15:266.016 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899055265494  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:44:15:266.026 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:44:15:266.036 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:44:15:266.151 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899055265972  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 43,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 14,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:44:15:266.171 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:44:15:268.210 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:39520::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:44:15:268.236 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:39520::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:44:15:268.244 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:39520::10.0.0.38:8086(-1):EvTcpConnected
2026-03-19 Thu 05:44:15:268.308 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:44:15:268.324 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:44:15:268.358 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: ClientInit
2026-03-19 Thu 05:44:15:268.377 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 1
2026-03-19 Thu 05:44:15:268.464 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:44:15:268.473 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:44:15:268.496 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SANDESH: Send FAILED: 1773899055268351  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:44:15:268.503 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:44:15:268.512 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:44:15:268.519 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:44:15:268.530 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:44:15:268.536 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:44:15:268.642 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SANDESH: Send FAILED: 1773899055268453  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 44,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:44:15:268.662 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:44:15:271.156 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: OnMessage control in state: ClientInit
2026-03-19 Thu 05:44:15:271.196 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2026-03-19 Thu 05:44:15:271.206 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: ClientInit : EvSandeshMessageRecv
2026-03-19 Thu 05:44:15:271.229 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Received Ctrl Message with size 0
2026-03-19 Thu 05:44:15:271.370 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899054265296 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899054265632 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 41 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 44,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2026-03-19 Thu 05:44:15:271.396 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:44:15:271.422 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 9
2026-03-19 Thu 05:44:15:271.435 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:44:15:271.443 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:44:15:271.450 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:44:15:271.478 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Established
2026-03-19 Thu 05:44:19:265.726 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:44:19:265.831 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:44:19:265.862 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:44:19:265.889 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:44:19:265.916 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:44:19:266.562 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1298fe0
2026-03-19 Thu 05:44:19:266.582 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:19:266.603 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:19:266.615 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129a260
2026-03-19 Thu 05:44:19:266.621 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:19:266.629 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:19:266.638 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129aba0
2026-03-19 Thu 05:44:19:266.644 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:19:266.652 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:19:266.663 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1299920
2026-03-19 Thu 05:44:19:266.672 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:19:266.687 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:19:266.698 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129b4e0
2026-03-19 Thu 05:44:19:266.716 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:44:19:266.729 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:44:19:267.158 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:19:267.204 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:19:267.227 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:19:267.245 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:19:267.258 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:19:267.268 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:19:267.292 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:19:267.340 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:19:267.356 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:19:267.370 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:19:267.380 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:19:267.393 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:44:19:267.402 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:44:19:267.417 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:19:267.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:44:44:266.493 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2026-03-19 Thu 05:45:44:267.838 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2026-03-19 Thu 05:46:21:026.091 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1299920
2026-03-19 Thu 05:46:21:027.417 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:027.501 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049
2026-03-19 Thu 05:46:21:027.515 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1298fe0
2026-03-19 Thu 05:46:21:027.535 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:027.561 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x129aba0
2026-03-19 Thu 05:46:21:027.571 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:027.592 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x129b4e0
2026-03-19 Thu 05:46:21:027.602 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:027.622 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x129a260
2026-03-19 Thu 05:46:21:027.632 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:028.083 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:21:028.127 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:21:028.142 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:21:028.155 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:21:028.169 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:21:057.096 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x12986a0
2026-03-19 Thu 05:46:21:057.157 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:057.302 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1297d60
2026-03-19 Thu 05:46:21:057.317 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:057.345 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1297420
2026-03-19 Thu 05:46:21:057.355 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:057.382 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1296ae0
2026-03-19 Thu 05:46:21:057.392 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:057.420 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049
2026-03-19 Thu 05:46:21:057.434 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x12961a0
2026-03-19 Thu 05:46:21:057.443 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:057.654 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:21:057.675 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:21:057.688 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:21:057.700 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:21:057.728 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:21:135.625 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x128e1d0
2026-03-19 Thu 05:46:21:135.690 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:135.831 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1295340
2026-03-19 Thu 05:46:21:135.846 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:135.870 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1295870
2026-03-19 Thu 05:46:21:135.881 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:135.902 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x1294ca0
2026-03-19 Thu 05:46:21:135.912 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:135.937 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049
2026-03-19 Thu 05:46:21:135.945 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Disconnect status: -1 0x12945f0
2026-03-19 Thu 05:46:21:135.953 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016
2026-03-19 Thu 05:46:21:136.165 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:21:136.700 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:21:136.727 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:21:136.741 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:21:136.753 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:21:172.095 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:39520::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed
2026-03-19 Thu 05:46:21:172.123 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:39520::10.0.0.38:8086(-1):EvTcpClose
2026-03-19 Thu 05:46:21:172.195 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvTcpClose in state Established
2026-03-19 Thu 05:46:21:172.228 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Established : EvTcpClose
2026-03-19 Thu 05:46:21:172.515 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086
2026-03-19 Thu 05:46:21:172.624 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:21:172.821 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: SANDESH: Send FAILED: 1773899181172324  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Established successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name = cn-jenkins-deploy-platform-ansible-os-5495-1. collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 150900 calls = 20 average_bytes = 7545 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 82,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 21,  ] ] ]
2026-03-19 Thu 05:46:21:172.849 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:21:172.860 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:21:172.887 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: SANDESH: Send FAILED: 1773899181172363  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Established : EvTcpClose -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:21:172.897 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:21:172.906 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvTcpDeleteSession in state Connect
2026-03-19 Thu 05:46:21:172.934 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:21:173.099 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: SANDESH: Send FAILED: 1773899181172610  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 150900 calls = 20 average_bytes = 7545 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 82,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 21,  ] ] ]
2026-03-19 Thu 05:46:21:173.120 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:21:175.550 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:58070::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:46:21:175.583 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:58070::10.0.0.33:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:46:21:175.591 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:58070::10.0.0.33:8086(-1):EvTcpConnected
2026-03-19 Thu 05:46:21:175.641 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:46:21:175.655 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:46:21:175.690 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: ClientInit
2026-03-19 Thu 05:46:21:175.720 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 2
2026-03-19 Thu 05:46:21:175.810 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:21:175.820 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:46:21:175.843 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: SANDESH: Send FAILED: 1773899181175683  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:21:175.850 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:46:21:175.859 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:21:175.866 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:46:21:175.877 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:21:175.883 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:46:21:176.026 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: SANDESH: Send FAILED: 1773899181175801  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 150900 calls = 20 average_bytes = 7545 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 83,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21,  _iter59->first = sent _iter59->second = 21,  ] ] ]
2026-03-19 Thu 05:46:21:176.045 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:46:21:199.121 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:58070::10.0.0.33:8086(-1) OnSessionEvent TCP Connection Closed
2026-03-19 Thu 05:46:21:199.162 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:58070::10.0.0.33:8086(-1):EvTcpClose
2026-03-19 Thu 05:46:21:199.249 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvTcpClose in state ClientInit
2026-03-19 Thu 05:46:21:199.292 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: ClientInit : EvTcpClose
2026-03-19 Thu 05:46:21:199.491 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Return to idle with 1000
2026-03-19 Thu 05:46:21:199.504 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Idle
2026-03-19 Thu 05:46:21:199.569 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:21:199.748 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899181199434  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 152473 calls = 21 average_bytes = 7260 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 83,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23,  _iter59->first = sent _iter59->second = 22,  ] ] ]
2026-03-19 Thu 05:46:21:199.775 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:21:199.788 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:21:199.811 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899181199476  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Down description = ClientInit : EvTcpClose ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:21:199.818 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:21:199.828 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:21:199.858 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:21:199.998 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899181199556  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 2 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 152473 calls = 21 average_bytes = 7260 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 83,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23,  _iter59->first = sent _iter59->second = 22,  ] ] ]
2026-03-19 Thu 05:46:21:200.016 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:22:200.134 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:46:22:200.544 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2026-03-19 Thu 05:46:22:200.734 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:22:200.852 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899182200247  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:22:201.410 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:22:201.427 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:22:201.697 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899182200700  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 2 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 152473 calls = 21 average_bytes = 7260 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 3 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 83,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26,  _iter59->first = sent _iter59->second = 22,  ] ] ]
2026-03-19 Thu 05:46:22:201.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:22:202.826 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:48818::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:46:22:202.860 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:48818::10.0.0.50:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:46:22:202.871 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:48818::10.0.0.50:8086(-1):EvTcpConnected
2026-03-19 Thu 05:46:22:203.003 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:46:22:203.634 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:46:22:203.686 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: ClientInit
2026-03-19 Thu 05:46:22:203.724 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 3
2026-03-19 Thu 05:46:22:203.846 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:22:203.861 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:46:22:203.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899182203676  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:22:203.920 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:46:22:203.934 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:22:203.945 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:46:22:203.962 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:22:203.973 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:46:22:204.229 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899182203831  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 3 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 152473 calls = 21 average_bytes = 7260 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 28,  _iter59->first = sent _iter59->second = 22,  ] ] ]
2026-03-19 Thu 05:46:22:204.255 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:46:22:205.599 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:48818::10.0.0.50:8086(-1) OnSessionEvent TCP Connection Closed
2026-03-19 Thu 05:46:22:205.631 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:48818::10.0.0.50:8086(-1):EvTcpClose
2026-03-19 Thu 05:46:22:205.695 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvTcpClose in state ClientInit
2026-03-19 Thu 05:46:22:205.718 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: ClientInit : EvTcpClose
2026-03-19 Thu 05:46:22:205.993 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Return to idle with 1000
2026-03-19 Thu 05:46:22:206.462 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Idle
2026-03-19 Thu 05:46:22:206.586 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:22:206.752 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899182205842  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 3 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 154046 calls = 22 average_bytes = 7002 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30,  _iter59->first = sent _iter59->second = 23,  ] ] ]
2026-03-19 Thu 05:46:22:206.777 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:22:206.789 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:22:206.814 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899182205885  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Down description = ClientInit : EvTcpClose ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:22:206.822 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:22:206.831 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:22:206.858 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:22:207.003 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899182206571  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 3 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 154046 calls = 22 average_bytes = 7002 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30,  _iter59->first = sent _iter59->second = 23,  ] ] ]
2026-03-19 Thu 05:46:22:207.018 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:23:206.191 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:46:23:206.650 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:46:23:207.617 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:23:207.658 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899183206484  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:23:207.668 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:23:207.678 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:23:207.835 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899183207602  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 3 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 154046 calls = 22 average_bytes = 7002 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 84,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33,  _iter59->first = sent _iter59->second = 23,  ] ] ]
2026-03-19 Thu 05:46:23:207.857 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:23:208.989 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:50848::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:46:23:209.017 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:50848::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:46:23:209.025 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:50848::10.0.0.38:8086(-1):EvTcpConnected
2026-03-19 Thu 05:46:23:209.068 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:46:23:209.092 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:46:23:209.123 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: ClientInit
2026-03-19 Thu 05:46:23:209.152 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 4
2026-03-19 Thu 05:46:23:209.233 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:23:209.243 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:46:23:209.447 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899183209116  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:23:209.456 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:46:23:209.465 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:23:209.472 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:46:23:209.484 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:23:209.490 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:46:23:209.627 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SANDESH: Send FAILED: 1773899183209224  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 4 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 154046 calls = 22 average_bytes = 7002 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 85,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35,  _iter59->first = sent _iter59->second = 23,  ] ] ]
2026-03-19 Thu 05:46:23:209.645 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:46:26:028.211 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:26:028.389 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:26:028.425 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:26:028.456 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:26:028.488 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:26:028.886 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:26:028.985 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:26:029.006 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:26:029.022 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:26:029.203 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:26:057.748 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:26:057.924 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:26:057.963 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:26:057.993 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:26:058.039 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:26:058.071 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:26:058.084 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:26:058.097 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:26:058.107 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:26:058.150 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:26:136.253 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:26:136.752 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:26:136.813 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:26:136.850 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:26:136.878 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:26:137.358 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:26:137.453 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:26:137.472 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:26:137.488 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:26:137.503 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:27:209.287 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: 10.0.0.38:8086 EvConnectTimerExpired in state ClientInit
2026-03-19 Thu 05:46:27:209.364 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvConnectTimerExpired in state ClientInit
2026-03-19 Thu 05:46:27:209.374 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: ClientInit : EvConnectTimerExpired
2026-03-19 Thu 05:46:27:209.584 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Return to idle with 1000
2026-03-19 Thu 05:46:27:209.595 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Idle
2026-03-19 Thu 05:46:27:209.657 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:27:209.890 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899187209453  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 4 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 155619 calls = 23 average_bytes = 6766 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 85,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37,  _iter59->first = sent _iter59->second = 24,  ] ] ]
2026-03-19 Thu 05:46:27:209.908 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:27:209.919 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:27:209.946 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899187209487  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Down description = ClientInit : EvConnectTimerExpired ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:27:209.956 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:27:209.969 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:27:209.999 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:27:210.161 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899187209647  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 4 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 155619 calls = 23 average_bytes = 6766 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 85,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37,  _iter59->first = sent _iter59->second = 24,  ] ] ]
2026-03-19 Thu 05:46:27:210.176 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:28:209.767 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:46:28:210.290 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086
2026-03-19 Thu 05:46:28:210.561 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:28:210.592 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899188210098  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:28:210.613 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:28:210.623 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:28:210.801 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899188210546  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 4 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 155619 calls = 23 average_bytes = 6766 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 85,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40,  _iter59->first = sent _iter59->second = 24,  ] ] ]
2026-03-19 Thu 05:46:28:210.824 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:28:213.285 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:51274::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:46:28:213.335 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:51274::10.0.0.33:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:46:28:213.344 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:51274::10.0.0.33:8086(-1):EvTcpConnected
2026-03-19 Thu 05:46:28:213.602 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:46:28:213.629 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:46:28:213.674 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: ClientInit
2026-03-19 Thu 05:46:28:213.696 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 5
2026-03-19 Thu 05:46:28:213.818 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:28:213.828 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:46:28:213.854 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: SANDESH: Send FAILED: 1773899188213665  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:28:213.862 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:46:28:213.872 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:28:213.878 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:46:28:213.891 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:46:28:213.897 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:46:28:214.077 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: SANDESH: Send FAILED: 1773899188213797  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 155619 calls = 23 average_bytes = 6766 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42,  _iter59->first = sent _iter59->second = 24,  ] ] ]
2026-03-19 Thu 05:46:28:214.098 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619263473408, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:46:31:029.007 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:31:029.138 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:31:029.173 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:31:029.202 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:31:029.245 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:31:029.489 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:31:029.527 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:31:029.541 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:31:029.554 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:31:029.598 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:31:058.106 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:31:058.309 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:31:058.344 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:31:058.382 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:31:058.412 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:31:058.443 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:31:058.476 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:31:058.492 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:31:058.516 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:31:058.529 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:31:137.473 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:31:137.617 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:31:137.652 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:31:137.680 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:31:137.707 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:31:137.923 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:31:137.961 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:31:137.995 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:31:138.070 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:31:138.092 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:32:800.573 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.50:51274::10.0.0.33:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507
2026-03-19 Thu 05:46:32:800.623 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.50:51274::10.0.0.33:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:46:32:800.647 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:51274::10.0.0.33:8086(-1) OnSessionEvent TCP Connection Closed
2026-03-19 Thu 05:46:32:800.656 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:51274::10.0.0.33:8086(-1):EvTcpClose
2026-03-19 Thu 05:46:32:800.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvTcpClose in state ClientInit
2026-03-19 Thu 05:46:32:800.778 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: ClientInit : EvTcpClose
2026-03-19 Thu 05:46:32:800.918 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Return to idle with 1000
2026-03-19 Thu 05:46:32:800.928 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Idle
2026-03-19 Thu 05:46:32:801.006 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:32:801.163 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899192800862  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 88,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:32:801.189 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:32:801.201 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:32:801.224 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899192800897  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Down description = ClientInit : EvTcpClose ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:32:801.232 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:32:801.241 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:32:801.270 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:32:801.400 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899192800993  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 88,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:32:801.416 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:33:801.535 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:46:33:801.772 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2026-03-19 Thu 05:46:33:801.871 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:33:801.902 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899193801626  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:33:801.912 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:33:801.937 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:33:802.046 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:46:33:802.081 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899193801859  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 88,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:33:802.100 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:33:802.088 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:46:33:802.159 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:46:33:802.187 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:46:33:802.670 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:46:33:802.728 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Idle
2026-03-19 Thu 05:46:33:802.812 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:33:802.999 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899193802620  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 88,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:33:803.024 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:33:803.036 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:33:803.058 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899193802645  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:33:803.065 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:33:803.074 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:33:803.095 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:33:803.227 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899193802798  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 89,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:33:803.241 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:36:029.566 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:36:029.698 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:36:029.753 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:36:029.783 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:36:029.813 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:36:030.044 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:36:030.087 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:36:030.108 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:36:030.189 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:36:030.214 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:36:058.388 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:36:058.556 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:36:058.584 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:36:058.618 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:36:058.646 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:36:058.674 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:36:058.705 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:36:058.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:36:058.757 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:36:058.769 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:36:137.996 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:36:138.169 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:36:138.207 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:36:138.237 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:36:138.280 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:36:138.557 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:36:138.681 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:36:138.699 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:36:138.729 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:36:138.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:41:030.139 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:41:030.322 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:41:030.360 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:41:030.393 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:41:030.448 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:41:030.996 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:41:031.100 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:41:031.119 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:41:031.134 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:41:031.149 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:41:058.642 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:41:058.860 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:41:058.894 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:41:058.944 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:41:059.010 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:41:059.040 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:41:059.092 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:41:059.127 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:41:059.145 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:41:059.165 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:41:138.740 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:41:138.913 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:41:138.964 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:41:138.995 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:41:139.023 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:41:139.460 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:41:139.555 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:41:139.573 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:41:139.593 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:41:139.609 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:44:268.550 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2026-03-19 Thu 05:46:44:268.634 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:44:268.753 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: SANDESH: Send FAILED: 1773899204268428  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 77 dequeues = 77 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 104 dequeues = 104 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899193802726 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899193803094 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:46:44:268.771 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:44:268.786 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:44:268.937 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: SANDESH: Send FAILED: 1773899204268531  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 89,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:44:268.975 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619259275008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:46:031.118 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:46:031.670 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:46:031.705 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:46:031.758 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:46:031.845 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:46:031.882 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:46:032.168 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:46:032.202 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:46:032.243 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:46:032.320 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:46:059.521 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:46:059.657 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:46:059.698 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:46:059.738 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:46:059.767 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:46:059.808 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:46:059.831 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:46:059.843 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:46:059.855 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:46:059.867 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:46:139.576 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:46:139.747 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:46:139.784 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:46:139.812 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:46:139.836 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:46:140.211 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:46:140.258 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:46:140.272 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:46:140.286 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:46:140.299 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:49:803.283 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:46:49:803.541 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:46:49:803.643 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:49:803.671 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SANDESH: Send FAILED: 1773899209803384  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:49:803.681 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:49:803.690 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:46:49:803.869 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: SANDESH: Send FAILED: 1773899209803629  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 89,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 54,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:49:803.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619787089664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:49:803.989 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:46:49:803.998 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:46:49:804.214 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:46:49:804.228 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:46:49:804.389 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:46:49:804.427 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Idle
2026-03-19 Thu 05:46:49:804.491 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:49:804.635 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899209804327  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 89,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 56,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:49:804.654 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:49:804.664 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:49:804.685 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899209804359  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:46:49:804.693 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:46:49:804.701 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:46:49:804.729 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:46:49:804.885 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899209804480  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 90,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 56,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:46:49:804.909 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:46:51:031.772 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:51:032.216 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:51:032.320 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:51:032.354 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:51:032.387 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:51:032.419 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:51:032.557 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:51:032.608 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:51:032.629 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:51:032.721 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:51:059.911 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:51:060.090 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:51:060.126 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:51:060.170 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:51:060.216 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:51:060.244 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:51:060.257 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:51:060.270 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:51:060.280 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:51:060.311 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:51:140.305 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:51:140.467 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:51:140.509 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:51:140.537 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:51:140.566 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:51:140.805 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:51:140.859 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:51:140.874 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:51:140.938 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:46:51:140.953 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:56:032.420 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:46:56:032.655 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:46:56:032.692 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:46:56:032.747 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:46:56:032.782 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:46:56:033.027 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:46:56:033.093 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:46:56:033.113 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:46:56:033.130 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:46:56:033.338 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:46:56:060.334 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:46:56:060.620 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:46:56:060.668 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:46:56:060.701 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:46:56:060.765 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:46:56:060.799 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:46:56:060.813 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:46:56:060.825 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:46:56:060.836 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:46:56:060.868 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:46:56:141.021 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:46:56:141.290 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:46:56:141.351 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:46:56:141.404 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:46:56:141.446 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:46:56:142.386 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:46:56:142.454 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:46:56:142.480 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:46:56:142.499 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:46:56:142.518 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:01:033.120 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:01:033.306 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:01:033.376 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:01:033.424 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:01:033.486 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:01:033.663 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:01:033.694 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:01:033.751 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:01:033.766 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:01:033.779 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:01:060.864 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:01:061.046 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:01:061.084 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:01:061.132 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:01:061.160 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:01:061.172 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:01:061.182 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:01:061.210 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:01:061.240 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:01:061.255 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:01:142.496 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:01:142.692 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:01:142.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:01:142.779 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:01:142.806 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:01:143.225 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:01:143.272 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:01:143.288 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:01:143.301 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:01:143.316 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:06:033.749 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:06:033.918 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:06:033.962 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:06:033.994 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:06:034.023 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:06:034.302 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:06:034.507 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:06:034.532 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:06:034.546 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:06:034.559 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:06:061.235 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:06:061.424 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:06:061.474 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:06:061.537 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:06:061.574 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:06:061.593 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:06:061.609 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:06:061.676 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:06:061.731 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:06:061.753 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:06:143.303 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:06:143.431 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:06:143.479 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:06:143.511 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:06:143.539 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:06:143.872 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:06:143.924 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:06:143.957 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:06:143.980 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:06:143.999 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:11:034.403 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:11:034.643 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:11:034.689 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:11:034.751 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:11:034.782 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:11:035.002 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:11:035.043 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:11:035.058 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:11:035.079 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:11:035.093 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:11:061.641 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:11:061.853 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:11:061.916 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:11:061.947 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:11:061.958 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:11:061.990 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:11:062.016 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:11:062.049 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:11:062.064 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:11:062.076 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:11:143.996 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:11:144.145 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:11:144.194 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:11:144.226 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:11:144.259 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:11:144.509 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:11:144.585 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:11:144.602 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:11:144.615 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:11:144.628 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:14:269.023 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:14:269.234 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899234268797  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 84 dequeues = 84 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 114 dequeues = 114 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899209804426 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899209804709 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:47:14:269.263 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:14:269.280 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:14:269.540 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899234268980  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 90,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:14:269.590 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:16:035.089 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:16:035.248 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:16:035.287 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:16:035.316 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:16:035.353 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:16:035.579 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:16:035.621 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:16:035.637 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:16:035.659 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:16:035.689 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:16:061.989 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:16:062.175 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:16:062.241 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:16:062.285 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:16:062.301 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:16:062.342 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:16:062.375 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:16:062.408 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:16:062.425 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:16:062.437 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:16:144.646 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:16:144.888 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:16:144.957 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:16:145.034 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:16:145.123 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:16:145.273 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:16:145.338 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:16:145.408 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:16:145.437 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:16:145.460 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:19:270.406 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:19:270.508 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899239270353  [SYS_NOTICE]: QEDbStatsUve: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. table_info= [  [ ] ] errors= [  write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [  [ ] ] cql_stats= [  requests_one_minute_rate = 0.121306 stats= [  total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [  connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] ]
2026-03-19 Thu 05:47:19:270.522 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: QEDbStatsUve
2026-03-19 Thu 05:47:19:805.115 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:47:19:805.348 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086
2026-03-19 Thu 05:47:19:805.456 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:47:19:805.487 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899239805201  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:47:19:805.497 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:19:805.507 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:47:19:805.731 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899239805444  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 90,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:19:806.762 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:19:806.374 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:47:19:806.795 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:47:19:807.498 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:47:19:807.515 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:47:19:807.636 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:47:19:807.668 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Idle
2026-03-19 Thu 05:47:19:807.739 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:19:807.887 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899239807585  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 90,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:19:807.904 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:19:807.916 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:19:807.944 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899239807611  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:47:19:807.952 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:19:807.961 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:47:19:807.970 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:19:808.095 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899239807729  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 91,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:19:808.108 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:21:036.217 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:21:036.359 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:21:036.401 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:21:036.443 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:21:036.473 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:21:037.395 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:21:037.440 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:21:037.464 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:21:037.482 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:21:037.496 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:21:062.335 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:21:062.519 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:21:062.581 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:21:062.608 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:21:062.619 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:21:062.650 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:21:062.677 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:21:062.707 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:21:062.753 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:21:062.766 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:21:145.365 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:21:145.530 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:21:145.566 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:21:145.596 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:21:145.621 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:21:145.870 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:21:145.925 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:21:145.954 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:21:145.968 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:21:145.982 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:26:037.719 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:26:037.866 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:26:037.922 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:26:037.965 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:26:037.993 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:26:038.334 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:26:038.379 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:26:038.397 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:26:038.411 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:26:038.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:26:062.653 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:26:062.818 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:26:062.870 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:26:062.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:26:062.906 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:26:062.936 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:26:063.064 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:26:063.116 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:26:063.138 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:26:063.157 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:26:145.971 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:26:146.142 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:26:146.180 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:26:146.209 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:26:146.238 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:26:146.524 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:26:146.634 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:26:146.652 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:26:146.707 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:26:146.757 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:31:038.416 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:31:038.571 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:31:038.610 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:31:038.643 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:31:038.706 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:31:039.081 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:31:039.188 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:31:039.211 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:31:039.232 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:31:039.249 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:31:062.937 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:31:063.084 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:31:063.139 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:31:063.163 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:31:063.178 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:31:063.209 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:31:063.246 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:31:063.277 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:31:063.292 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:31:063.305 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:31:146.628 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:31:146.825 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:31:146.865 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:31:146.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:31:146.924 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:31:150.223 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:31:150.324 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:31:150.349 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:31:150.371 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:31:150.392 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:36:039.222 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:36:039.407 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:36:039.445 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:36:039.475 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:36:039.500 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:36:039.993 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:36:040.091 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:36:040.109 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:36:040.130 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:36:040.151 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:36:063.224 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:36:063.435 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:36:063.535 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:36:063.571 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:36:063.587 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:36:063.624 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:36:063.651 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:36:063.684 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:36:063.698 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:36:063.710 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:36:150.358 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:36:150.526 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:36:150.561 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:36:150.604 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:36:150.643 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:36:151.378 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:36:151.470 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:36:151.489 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:36:151.505 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:36:151.520 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:41:040.143 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:41:040.318 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:41:040.363 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:41:040.394 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:41:040.421 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:41:040.796 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129a260
2026-03-19 Thu 05:47:41:040.841 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129aba0
2026-03-19 Thu 05:47:41:040.857 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1298fe0
2026-03-19 Thu 05:47:41:040.882 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x129b4e0
2026-03-19 Thu 05:47:41:040.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1299920
2026-03-19 Thu 05:47:41:063.611 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:41:063.802 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12986a0
2026-03-19 Thu 05:47:41:063.829 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:41:063.864 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:41:063.894 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:41:063.922 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:41:063.956 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297d60
2026-03-19 Thu 05:47:41:063.972 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1297420
2026-03-19 Thu 05:47:41:063.984 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1296ae0
2026-03-19 Thu 05:47:41:063.996 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12961a0
2026-03-19 Thu 05:47:41:151.500 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:41:158.202 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:41:158.272 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:41:158.319 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:41:158.362 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:41:158.667 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x12945f0
2026-03-19 Thu 05:47:41:159.063 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295340
2026-03-19 Thu 05:47:41:159.098 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x128e1d0
2026-03-19 Thu 05:47:41:159.120 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1294ca0
2026-03-19 Thu 05:47:41:159.142 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: -1 0x1295870
2026-03-19 Thu 05:47:44:270.099 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2026-03-19 Thu 05:47:44:270.172 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:44:270.241 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: SANDESH: Send FAILED: 1773899264269943  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 92 dequeues = 92 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 125 dequeues = 125 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899239807666 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899239807969 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:47:44:270.266 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:44:270.276 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:44:270.484 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: SANDESH: Send FAILED: 1773899264270072  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 79 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 91,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 67,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:44:270.537 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:46:040.869 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129a260
2026-03-19 Thu 05:47:46:040.988 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129aba0
2026-03-19 Thu 05:47:46:041.026 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1298fe0
2026-03-19 Thu 05:47:46:041.057 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x129b4e0
2026-03-19 Thu 05:47:46:041.086 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1299920
2026-03-19 Thu 05:47:46:041.286 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129a260
2026-03-19 Thu 05:47:46:041.298 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:041.324 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:041.349 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129aba0
2026-03-19 Thu 05:47:46:041.355 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:041.364 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:041.392 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1298fe0
2026-03-19 Thu 05:47:46:041.398 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:041.406 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:041.418 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x129b4e0
2026-03-19 Thu 05:47:46:041.423 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:041.431 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:041.460 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1299920
2026-03-19 Thu 05:47:46:041.466 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:041.474 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:041.771 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:041.799 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:041.833 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:041.847 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:041.861 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:041.873 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:041.885 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:041.897 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:041.906 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:043.121 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:46:043.133 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:043.162 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899266041939  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.50:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:47:46:043.172 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:46:043.182 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:043.201 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:043.222 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:043.241 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:043.260 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:063.865 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12986a0
2026-03-19 Thu 05:47:46:064.042 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12986a0
2026-03-19 Thu 05:47:46:064.057 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:064.086 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:064.098 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297d60
2026-03-19 Thu 05:47:46:064.151 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1297420
2026-03-19 Thu 05:47:46:064.202 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1296ae0
2026-03-19 Thu 05:47:46:064.252 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12961a0
2026-03-19 Thu 05:47:46:064.319 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1297d60
2026-03-19 Thu 05:47:46:064.327 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:064.340 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:064.349 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1297420
2026-03-19 Thu 05:47:46:064.355 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:064.377 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:064.390 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1296ae0
2026-03-19 Thu 05:47:46:064.398 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:064.410 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:064.422 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12961a0
2026-03-19 Thu 05:47:46:064.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:064.441 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:065.868 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:065.905 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:065.929 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:065.944 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:065.961 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:065.971 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:065.986 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:066.000 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:066.020 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:066.032 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:066.058 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:066.675 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:46:066.722 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899266066087  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:47:46:066.732 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:46:066.781 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:066.803 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:066.823 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:066.837 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:158.882 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x12945f0
2026-03-19 Thu 05:47:46:164.201 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x12945f0
2026-03-19 Thu 05:47:46:164.237 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:164.267 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:164.280 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295340
2026-03-19 Thu 05:47:46:164.361 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x128e1d0
2026-03-19 Thu 05:47:46:164.389 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1294ca0
2026-03-19 Thu 05:47:46:164.415 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x1295870
2026-03-19 Thu 05:47:46:164.691 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1295340
2026-03-19 Thu 05:47:46:164.702 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:164.726 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:164.808 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x128e1d0
2026-03-19 Thu 05:47:46:164.816 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:164.826 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:164.841 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1294ca0
2026-03-19 Thu 05:47:46:164.846 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:164.855 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:164.876 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: RAC_Connect status: 0 0x1295870
2026-03-19 Thu 05:47:46:164.882 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:47:46:164.891 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2026-03-19 Thu 05:47:46:164.938 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:164.949 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:164.973 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:165.249 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:165.261 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:165.889 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:46:165.920 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: SANDESH: Send FAILED: 1773899266165292  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:47:46:165.930 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619255076608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:46:165.950 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:165.969 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:165.979 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:165.992 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:166.001 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:166.014 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2026-03-19 Thu 05:47:46:166.023 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2026-03-19 Thu 05:47:46:166.045 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:166.059 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:46:166.072 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2026-03-19 Thu 05:47:49:808.403 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:47:49:808.604 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2026-03-19 Thu 05:47:49:808.701 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:47:49:808.746 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899269808476  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:47:49:808.760 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:49:808.773 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:47:49:808.913 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: SANDESH: Send FAILED: 1773899269808689  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 151,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 72,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:49:808.933 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619795486464, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:49:811.234 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2026-03-19 Thu 05:47:49:811.253 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: -(-1):EvTcpConnectFail
2026-03-19 Thu 05:47:49:812.108 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2026-03-19 Thu 05:47:49:812.124 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Connect : EvTcpConnectFail
2026-03-19 Thu 05:47:49:814.075 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2026-03-19 Thu 05:47:49:814.115 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Idle
2026-03-19 Thu 05:47:49:814.181 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:49:814.329 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899269812193  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 151,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:49:814.350 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:47:49:814.360 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:49:814.384 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899269812222  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:47:49:814.391 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:47:49:814.400 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:47:49:814.425 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:47:49:814.553 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899269814171  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 152,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:47:49:814.573 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:48:14:270.877 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:48:14:271.035 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899294270696  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 102 dequeues = 102 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 138 dequeues = 138 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899269814113 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899269814424 ] max_sm_queue_count = 5 ]
2026-03-19 Thu 05:48:14:271.052 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:48:14:271.063 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:48:14:271.285 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SANDESH: Send FAILED: 1773899294270827  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 152,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 77,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:48:14:271.319 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:48:19:271.953 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:48:19:272.053 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SANDESH: Send FAILED: 1773899299271911  [SYS_NOTICE]: QEDbStatsUve: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. table_info= [  [ ] ] errors= [  write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [  [ ] ] cql_stats= [  requests_one_minute_rate = 0.121306 stats= [  total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [  connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] ]
2026-03-19 Thu 05:48:19:272.065 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: QEDbStatsUve
2026-03-19 Thu 05:48:19:814.784 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2026-03-19 Thu 05:48:19:815.025 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:48:19:815.124 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:48:19:815.154 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899299814878  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:48:19:815.178 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:48:19:815.187 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:48:19:815.326 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: SANDESH: Send FAILED: 1773899299815112  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 152,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:48:19:815.341 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619280267008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:48:19:817.443 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:38726::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2026-03-19 Thu 05:48:19:817.477 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:38726::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:48:19:817.486 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619960150144, Pid 1]: 10.0.0.50:38726::10.0.0.38:8086(-1):EvTcpConnected
2026-03-19 Thu 05:48:19:817.544 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:48:19:817.572 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:48:19:817.617 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: ClientInit
2026-03-19 Thu 05:48:19:817.634 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 6
2026-03-19 Thu 05:48:19:817.722 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:48:19:817.732 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:48:19:817.754 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899299817610  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:48:19:817.762 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:48:19:817.774 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:48:19:817.781 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:48:19:817.792 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:48:19:817.798 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:48:19:817.939 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: SANDESH: Send FAILED: 1773899299817704  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 6 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 153,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 82,  _iter59->first = sent _iter59->second = 25,  ] ] ]
2026-03-19 Thu 05:48:19:817.957 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619812280064, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:48:19:820.991 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619267671808, Pid 1]: OnMessage control in state: ClientInit
2026-03-19 Thu 05:48:19:821.046 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2026-03-19 Thu 05:48:19:821.068 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: ClientInit : EvSandeshMessageRecv
2026-03-19 Thu 05:48:19:821.098 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Received Ctrl Message with size 0
2026-03-19 Thu 05:48:19:821.307 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 6 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 157192 calls = 24 average_bytes = 6549 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 102 dequeues = 102 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 138 dequeues = 138 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1773899269814113 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1773899269814424 ] session_stats= [  num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 15 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [  bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] session_tx_socket_stats= [  bytes = 117018 calls = 14 average_bytes = 8358 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 153,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 82,  _iter59->first = sent _iter59->second = 25,  ] ] max_sm_queue_count = 5 proxy  seq 58
2026-03-19 Thu 05:48:19:821.337 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:48:19:821.362 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 40
2026-03-19 Thu 05:48:19:821.375 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:48:19:821.409 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2. table_info= [  [ ] ] errors= [  write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [  [ ] ] cql_stats= [  requests_one_minute_rate = 0.121306 stats= [  total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [  connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] proxy  seq 5
2026-03-19 Thu 05:48:19:821.419 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:48:19:821.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:48:19:821.459 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: Established
2026-03-19 Thu 05:48:44:271.708 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619816478464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2026-03-19 Thu 05:49:44:272.667 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619271870208, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0
2026-03-19 Thu 05:50:44:273.344 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619808081664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0
2026-03-19 Thu 05:51:44:275.100 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619284465408, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0
2026-03-19 Thu 05:52:41:960.856 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvStop in state Established
2026-03-19 Thu 05:52:41:961.004 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Idle
2026-03-19 Thu 05:52:41:961.106 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2026-03-19 Thu 05:52:41:961.118 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2026-03-19 Thu 05:52:41:961.266 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: SANDESH: Send FAILED: 1773899561961093  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1773899018102117 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  ] ] rx_socket_stats= [  bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 405623 calls = 48 average_bytes = 8450 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QEDbStatsUve [  messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 2 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlClientToServer [  messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshCtrlServerToClient [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 28 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 153,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 84,  _iter59->first = sent _iter59->second = 52,  ] ] ]
2026-03-19 Thu 05:52:41:961.291 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 140619276068608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:53:08:987.999 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: http-server-port 8091
2026-03-19 Thu 05:53:08:988.068 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Max-tasks 16
2026-03-19 Thu 05:53:08:988.076 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Max-slice 100
2026-03-19 Thu 05:53:08:988.082 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Collectors  10.0.0.38:8086
2026-03-19 Thu 05:53:08:988.087 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Collectors  10.0.0.50:8086
2026-03-19 Thu 05:53:08:988.091 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Collectors  10.0.0.33:8086
2026-03-19 Thu 05:53:08:988.112 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: ROLE             : Generator
2026-03-19 Thu 05:53:08:988.118 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2026-03-19 Thu 05:53:08:988.123 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-5495-2.
2026-03-19 Thu 05:53:08:988.128 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: NODE TYPE        : Database
2026-03-19 Thu 05:53:08:988.132 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: INSTANCE ID      : 0
2026-03-19 Thu 05:53:08:988.137 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2026-03-19 Thu 05:53:08:988.143 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2026-03-19 Thu 05:53:08:995.128 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: HTTP Introspect Init
2026-03-19 Thu 05:53:08:995.255 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 138
2026-03-19 Thu 05:53:08:995.348 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Sandesh Http Server Port: 8091
2026-03-19 Thu 05:53:08:995.407 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2026-03-19 Thu 05:53:08:995.415 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2026-03-19 Thu 05:53:08:996.994 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Idle
2026-03-19 Thu 05:53:08:997.155 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: No Client: 1773899588997096  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:53:08:997.307 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2026-03-19 Thu 05:53:08:997.322 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2026-03-19 Thu 05:53:08:997.334 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 
2026-03-19 Thu 05:53:08:997.416 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvStart in state Idle
2026-03-19 Thu 05:53:08:997.499 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Disconnect
2026-03-19 Thu 05:53:08:997.559 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2026-03-19 Thu 05:53:08:997.757 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2026-03-19 Thu 05:53:08:997.819 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:08:997.837 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SANDESH: Send FAILED: 1773899588997493  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:53:08:997.844 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:53:08:997.853 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:08:997.913 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SANDESH: Send FAILED: 1773899588997548  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:53:08:997.929 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:53:08:997.937 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:08:997.983 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SANDESH: Send FAILED: 1773899588997589  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:53:08:997.994 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:53:08:998.001 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:08:998.013 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SANDESH: Send FAILED: 1773899588997606  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:53:08:998.019 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:53:08:998.026 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:08:998.065 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SANDESH: Send FAILED: 1773899588997807  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:53:08:998.076 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2026-03-19 Thu 05:53:09:073.197 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2026-03-19 Thu 05:53:09:077.910 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:35374::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282
2026-03-19 Thu 05:53:09:077.943 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: 10.0.0.50:35374::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2026-03-19 Thu 05:53:09:077.953 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: 10.0.0.50:35374::10.0.0.38:8086(-1):EvTcpConnected
2026-03-19 Thu 05:53:09:077.979 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Processing scm::EvSandeshSend in state Connect
2026-03-19 Thu 05:53:09:078.032 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: SANDESH: Send FAILED: 1773899589076172  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:53:09:078.041 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2026-03-19 Thu 05:53:09:078.058 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Processing scm::EvTcpConnected in state Connect
2026-03-19 Thu 05:53:09:078.065 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2026-03-19 Thu 05:53:09:078.101 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: ClientInit
2026-03-19 Thu 05:53:09:078.116 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-5495-2.:contrail-query-engine:0:Database count 1
2026-03-19 Thu 05:53:09:078.197 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:078.206 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:53:09:078.220 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: SANDESH: Send FAILED: 1773899589078096  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2026-03-19 Thu 05:53:09:078.227 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:53:09:078.234 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:078.239 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2026-03-19 Thu 05:53:09:078.263 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:078.269 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2026-03-19 Thu 05:53:09:078.348 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: SANDESH: Send FAILED: 1773899589078183  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 3,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2026-03-19 Thu 05:53:09:078.364 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865203140160, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2026-03-19 Thu 05:53:09:077.984 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf67430
2026-03-19 Thu 05:53:09:079.232 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.248 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.271 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf67ff0
2026-03-19 Thu 05:53:09:079.277 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.285 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.295 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf68c30
2026-03-19 Thu 05:53:09:079.300 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.307 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.316 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf69870
2026-03-19 Thu 05:53:09:079.321 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.328 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.340 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf64540
2026-03-19 Thu 05:53:09:079.345 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.352 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.364 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf64df0
2026-03-19 Thu 05:53:09:079.368 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.375 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.384 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf5f540
2026-03-19 Thu 05:53:09:079.389 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.396 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.405 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6a4b0
2026-03-19 Thu 05:53:09:079.409 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.417 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.426 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf66770
2026-03-19 Thu 05:53:09:079.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.437 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.450 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf65ab0
2026-03-19 Thu 05:53:09:079.455 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.462 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.471 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6b0f0
2026-03-19 Thu 05:53:09:079.476 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.483 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.493 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6bd30
2026-03-19 Thu 05:53:09:079.498 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.504 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.513 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6c970
2026-03-19 Thu 05:53:09:079.518 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.525 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.534 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6e1f0
2026-03-19 Thu 05:53:09:079.538 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.546 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.554 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: RAC_Connect status: 0 0xf6d5b0
2026-03-19 Thu 05:53:09:079.559 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: Connected to REDIS...

2026-03-19 Thu 05:53:09:079.566 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028
2026-03-19 Thu 05:53:09:079.789 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:079.802 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:079.868 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:079.883 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:079.894 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:079.895 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:079.968 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:079.978 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:079.990 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:079.997 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.008 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.016 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.049 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.062 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.074 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.085 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.139 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.163 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SANDESH: Send FAILED: 1773899589079836  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2026-03-19 Thu 05:53:09:080.170 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.185 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:080.191 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.205 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SANDESH: Send FAILED: 1773899589080041  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:53:09:080.213 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.457 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.472 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.491 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.503 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.511 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.523 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.530 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.541 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.549 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.560 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.567 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.584 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.593 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.603 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.611 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.654 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.666 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.677 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.687 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.703 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.713 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.738 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:080.746 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:080.756 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:080.780 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:080.790 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.809 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: SANDESH: Send FAILED: 1773899589080633  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:53:09:080.822 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.830 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2026-03-19 Thu 05:53:09:080.840 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2026-03-19 Thu 05:53:09:080.853 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: SANDESH: Send FAILED: 1773899589080699  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2026-03-19 Thu 05:53:09:080.859 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865148298816, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2026-03-19 Thu 05:53:09:089.236 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:089.269 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:089.315 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080
2026-03-19 Thu 05:53:09:089.324 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087
2026-03-19 Thu 05:53:09:089.341 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:089.361 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705
2026-03-19 Thu 05:53:09:089.476 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: OnMessage control in state: ClientInit
2026-03-19 Thu 05:53:09:089.538 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2026-03-19 Thu 05:53:09:089.547 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: ClientInit : EvSandeshMessageRecv
2026-03-19 Thu 05:53:09:089.567 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: Received Ctrl Message with size 0
2026-03-19 Thu 05:53:09:089.657 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1773899588997017 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 3,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6,  _iter59->first = sent _iter59->second = 0,  ] ] proxy  seq 5
2026-03-19 Thu 05:53:09:089.685 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:53:09:089.706 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-5495-2. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 8
2026-03-19 Thu 05:53:09:089.718 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2026-03-19 Thu 05:53:09:089.736 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:53:09:089.744 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2026-03-19 Thu 05:53:09:089.778 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: Established
2026-03-19 Thu 05:54:08:998.503 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2026-03-19 Thu 05:55:08:999.388 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2026-03-19 Thu 05:56:09:003.269 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865165092416, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2026-03-19 Thu 05:57:09:003.722 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865165092416, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2026-03-19 Thu 05:58:09:004.314 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2026-03-19 Thu 05:59:09:004.869 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0
2026-03-19 Thu 06:00:09:005.742 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0
2026-03-19 Thu 06:01:09:006.291 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0
2026-03-19 Thu 06:02:09:006.928 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865068922432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0
2026-03-19 Thu 06:03:09:007.678 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865165092416, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0
2026-03-19 Thu 06:04:09:008.222 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0
2026-03-19 Thu 06:05:09:008.795 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865064724032, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0
2026-03-19 Thu 06:06:09:009.458 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865288123968, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0
2026-03-19 Thu 06:07:09:010.137 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0
2026-03-19 Thu 06:08:09:010.969 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0
2026-03-19 Thu 06:09:09:011.653 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865068922432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0
2026-03-19 Thu 06:10:09:012.392 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0
2026-03-19 Thu 06:10:22:435.924 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:35526 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256
2026-03-19 Thu 06:10:28:011.667 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:35532 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256
2026-03-19 Thu 06:11:09:012.966 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0
2026-03-19 Thu 06:12:01:008.132 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.38:59606 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256
2026-03-19 Thu 06:12:09:013.489 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865068922432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0
2026-03-19 Thu 06:12:24:675.540 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: StartPipeline on : Redis:10.0.0.38 Port:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 812
2026-03-19 Thu 06:12:24:676.587 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog:  Got Query to prepare for QID 9908c0d6-235a-11f1-bd11-00000a000026 src/contrail-analytics/contrail-query-engine/query.cc 1165
2026-03-19 Thu 06:12:24:676.646 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026  :0:json query is:  { end_time: 1773900744591684 , enqueue_time: 1773900744674818 , query_metadata: {"enqueue_time": 1773900744674717} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "00d7eb24-0beb-4c53-8aa7-7b03c789c5fa", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:24:676.842 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Chunks: 3 Need Merge: 0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 936
2026-03-19 Thu 06:12:24:676.859 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Getting Least Loaded Conn as :0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 986
2026-03-19 Thu 06:12:24:676.910 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Starting Pipeline for 9908c0d6-235a-11f1-bd11-00000a000026 , 1 conn, 16 tasks src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 994
2026-03-19 Thu 06:12:24:677.120 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026  :0:json query is:  { end_time: 1773900744591684 , enqueue_time: 1773900744674818 , query_metadata: {"enqueue_time": 1773900744674717} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "00d7eb24-0beb-4c53-8aa7-7b03c789c5fa", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:24:725.352 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.400 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.408 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.415 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.422 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.429 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.439 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.468 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.479 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.488 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.553 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026  :0:json query is:  { end_time: 1773900744591684 , enqueue_time: 1773900744674818 , query_metadata: {"enqueue_time": 1773900744674717} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "00d7eb24-0beb-4c53-8aa7-7b03c789c5fa", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:24:725.740 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.773 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.782 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 5 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.793 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.801 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 5 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.810 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.818 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 5 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.826 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:725.838 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 5 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:725.846 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 5 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:726.021 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id 00d7eb24-0beb-4c53-8aa7-7b03c789c5fa src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:24:726.132 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id 00d7eb24-0beb-4c53-8aa7-7b03c789c5fa src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:24:726.235 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id 00d7eb24-0beb-4c53-8aa7-7b03c789c5fa src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:24:726.331 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id 00d7eb24-0beb-4c53-8aa7-7b03c789c5fa src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:24:726.430 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QEQueryLog: 9908c0d6-235a-11f1-bd11-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id 00d7eb24-0beb-4c53-8aa7-7b03c789c5fa src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:24:727.253 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:727.276 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:727.284 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:727.291 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:727.297 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:727.310 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:727.317 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:727.331 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:727.337 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:24:727.344 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: 9908c0d6-235a-11f1-bd11-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:24:727.587 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: Will Jsonify #rows 5 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 542
2026-03-19 Thu 06:12:24:727.636 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: Did Jsonify #rows 5 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 551
2026-03-19 Thu 06:12:24:727.719 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: QE Query Result is {"progress":100, "lines":1, "count":5} src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 586
2026-03-19 Thu 06:12:24:728.277 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog: Finished: QID 9908c0d6-235a-11f1-bd11-00000a000026 Table ObjectVMTable Time(ms) 51 RedisTime(ms) 0 MergeTime(ms) 0 Rows 5 EnQ-delay1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 661
2026-03-19 Thu 06:12:24:728.324 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QELog:  Result 1 , 1 conn src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 699
2026-03-19 Thu 06:12:24:728.366 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]:  [SYS_INFO]: QueryPerfInfo: name = cn-jenkins-deploy-platform-ansible-os-5495-2. table = ObjectVMTable query_stats= [  qid = 9908c0d6-235a-11f1-bd11-00000a000026 where = [[{"name": "ObjectId", "value": "00d7eb24-0beb-4c53-8aa7-7b03c789c5fa", "op": 1, "value2": null}]] select = { "select" : ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] } post =  time_span = 8 error = None chunks = 3 chunk_where_time = 48,0,     50,0,          46,0,  chunk_select_time = 0,0,     0,0,          0,0,  chunk_postproc_time = 0,0,     0,0,          0,0,  chunk_merge_time =                  final_merge_time = 0 time = 51 rows = 5 enq_delay = 1 ] file = src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc line = 657
2026-03-19 Thu 06:12:27:765.645 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: StartPipeline on : Redis:10.0.0.38 Port:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 812
2026-03-19 Thu 06:12:27:766.940 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog:  Got Query to prepare for QID 9ae07b2f-235a-11f1-9b2f-00000a000026 src/contrail-analytics/contrail-query-engine/query.cc 1165
2026-03-19 Thu 06:12:27:767.017 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QEQueryLog: 9ae07b2f-235a-11f1-9b2f-00000a000026  :0:json query is:  { end_time: 1773900747751162 , enqueue_time: 1773900747765094 , query_metadata: {"enqueue_time": 1773900747764987} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectRoutingInstance" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-47331943:ctest-vn22-00062871:ctest-vn22-00062871", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:27:767.214 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Chunks: 3 Need Merge: 0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 936
2026-03-19 Thu 06:12:27:767.233 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Getting Least Loaded Conn as :0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 986
2026-03-19 Thu 06:12:27:767.272 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]:  [SYS_INFO]: QELog: Starting Pipeline for 9ae07b2f-235a-11f1-9b2f-00000a000026 , 1 conn, 16 tasks src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 994
2026-03-19 Thu 06:12:27:767.427 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]:  [SYS_INFO]: QEQueryLog: 9ae07b2f-235a-11f1-9b2f-00000a000026  :0:json query is:  { end_time: 1773900747751162 , enqueue_time: 1773900747765094 , query_metadata: {"enqueue_time": 1773900747764987} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectRoutingInstance" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-47331943:ctest-vn22-00062871:ctest-vn22-00062871", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:27:803.114 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.163 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.171 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.179 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.187 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.213 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.201 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.220 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.272 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.279 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.279 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.307 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.294 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.341 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.348 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.354 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.361 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 1 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.372 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 1 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.387 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 1 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:803.395 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 1 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:803.658 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]:  [SYS_INFO]: QEQueryLog: 9ae07b2f-235a-11f1-9b2f-00000a000026 ObjectRoutingInstance :1:Column ObjectTypeName1 Table ObjectRoutingInstance object_id default-domain:ctest-AnalyticsBasicTestSanity-47331943:ctest-vn22-00062871:ctest-vn22-00062871 src/contrail-analytics/contrail-query-engine/select.cc 1022
2026-03-19 Thu 06:12:27:804.038 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:804.061 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:804.068 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:804.075 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:804.082 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:804.089 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:804.096 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:804.102 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:804.109 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59
2026-03-19 Thu 06:12:27:804.116 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: 9ae07b2f-235a-11f1-9b2f-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66
2026-03-19 Thu 06:12:27:804.197 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QEQueryLog: 9ae07b2f-235a-11f1-9b2f-00000a000026  :0:json query is:  { end_time: 1773900747751162 , enqueue_time: 1773900747765094 , query_metadata: {"enqueue_time": 1773900747764987} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1773900725601133 , table: "ObjectRoutingInstance" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-47331943:ctest-vn22-00062871:ctest-vn22-00062871", "op": 1, "value2": null}]] }  src/contrail-analytics/contrail-query-engine/query.cc 467
2026-03-19 Thu 06:12:27:804.467 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: Will Jsonify #rows 1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 542
2026-03-19 Thu 06:12:27:804.532 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: Did Jsonify #rows 1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 551
2026-03-19 Thu 06:12:27:804.584 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]:  [SYS_INFO]: QELog: QE Query Result is {"progress":100, "lines":1, "count":1} src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 586
2026-03-19 Thu 06:12:27:805.188 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog: Finished: QID 9ae07b2f-235a-11f1-9b2f-00000a000026 Table ObjectRoutingInstance Time(ms) 38 RedisTime(ms) 0 MergeTime(ms) 0 Rows 1 EnQ-delay1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 661
2026-03-19 Thu 06:12:27:805.250 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865190544960, Pid 1]:  [SYS_INFO]: QueryPerfInfo: name = cn-jenkins-deploy-platform-ansible-os-5495-2. table = ObjectRoutingInstance query_stats= [  qid = 9ae07b2f-235a-11f1-9b2f-00000a000026 where = [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-47331943:ctest-vn22-00062871:ctest-vn22-00062871", "op": 1, "value2": null}]] select = { "select" : ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] } post =  time_span = 8 error = None chunks = 3 chunk_where_time = 36,0,    35,0,    35,0,         chunk_select_time = 0,0,    0,0,    0,0,         chunk_postproc_time = 0,0,    0,0,    0,0,         chunk_merge_time =                  final_merge_time = 0 time = 38 rows = 1 enq_delay = 1 ] file = src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc line = 657
2026-03-19 Thu 06:12:27:805.256 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865194743360, Pid 1]:  [SYS_INFO]: QELog:  Result 1 , 1 conn src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 699
2026-03-19 Thu 06:13:09:014.433 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0
2026-03-19 Thu 06:14:09:015.179 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865165092416, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0
2026-03-19 Thu 06:15:09:015.821 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0
2026-03-19 Thu 06:16:09:016.374 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0
2026-03-19 Thu 06:17:09:017.682 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865156695616, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0
2026-03-19 Thu 06:18:09:018.292 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0
2026-03-19 Thu 06:19:09:019.834 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0
2026-03-19 Thu 06:20:09:020.370 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865198941760, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0
2026-03-19 Thu 06:21:09:021.023 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865160894016, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0
2026-03-19 Thu 06:22:09:027.587 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0
2026-03-19 Thu 06:23:09:028.206 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865169290816, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0
2026-03-19 Thu 06:24:09:028.810 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865207338560, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0
2026-03-19 Thu 06:24:32:240.544 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.38:45794 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256
2026-03-19 Thu 06:25:09:029.592 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865068922432, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 32 without seqno , total = 0
2026-03-19 Thu 06:26:09:030.177 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865152497216, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 33 without seqno , total = 0
2026-03-19 Thu 06:26:54:814.447 UTC  cn-jenkins-deploy-platform-ansible-os-5495-2 [Thread 139865295263872, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.50:8091::10.0.0.50:57274 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256