2025-11-10 Mon 05:04:10:213.012 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: http-server-port 8091
2025-11-10 Mon 05:04:10:213.108 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Max-tasks 16
2025-11-10 Mon 05:04:10:213.117 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Max-slice 100
2025-11-10 Mon 05:04:10:213.123 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Collectors  10.0.0.38:8086
2025-11-10 Mon 05:04:10:213.128 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Collectors  10.0.0.50:8086
2025-11-10 Mon 05:04:10:213.133 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Collectors  10.0.0.33:8086
2025-11-10 Mon 05:04:10:213.154 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: ROLE             : Generator
2025-11-10 Mon 05:04:10:213.160 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-11-10 Mon 05:04:10:213.165 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-4678-1.
2025-11-10 Mon 05:04:10:213.171 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: NODE TYPE        : Database
2025-11-10 Mon 05:04:10:213.176 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-11-10 Mon 05:04:10:213.182 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-11-10 Mon 05:04:10:213.187 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-11-10 Mon 05:04:10:217.321 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: HTTP Introspect Init
2025-11-10 Mon 05:04:10:217.454 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-11-10 Mon 05:04:10:217.513 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Sandesh Http Server Port: 8091
2025-11-10 Mon 05:04:10:217.559 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-11-10 Mon 05:04:10:217.568 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-11-10 Mon 05:04:10:217.646 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Idle
2025-11-10 Mon 05:04:10:217.807 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: No Client: 1762751050217731  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:10:221.145 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-11-10 Mon 05:04:10:221.180 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-11-10 Mon 05:04:10:221.196 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 
2025-11-10 Mon 05:04:10:222.524 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvStart in state Idle
2025-11-10 Mon 05:04:10:222.592 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Disconnect
2025-11-10 Mon 05:04:10:222.709 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-11-10 Mon 05:04:10:223.147 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086
2025-11-10 Mon 05:04:10:223.223 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:223.246 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: SANDESH: Send FAILED: 1762751050222583  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-11-10 Mon 05:04:10:223.255 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:10:223.263 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:223.354 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: SANDESH: Send FAILED: 1762751050222662  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:10:223.372 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:10:223.382 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:223.453 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: SANDESH: Send FAILED: 1762751050222759  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:10:223.465 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:10:223.473 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:224.873 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: SANDESH: Send FAILED: 1762751050223007  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-11-10 Mon 05:04:10:224.894 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:10:224.904 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:224.982 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: SANDESH: Send FAILED: 1762751050223211  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.33:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:10:224.999 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341925771008, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:10:255.629 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-11-10 Mon 05:04:10:255.979 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:10:256.078 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:10:256.148 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:10:256.207 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: SANDESH: Send FAILED: 1762751050256040  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-11-10 Mon 05:04:10:256.219 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:15:264.153 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-11-10 Mon 05:04:15:264.211 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:15:264.264 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:20:267.773 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-11-10 Mon 05:04:20:267.814 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:20:267.837 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:25:272.696 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-11-10 Mon 05:04:25:272.776 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:25:272.810 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:30:426.630 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-11-10 Mon 05:04:30:426.683 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:30:426.708 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:35:465.191 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-11-10 Mon 05:04:35:465.236 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:35:465.258 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:40:500.465 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-11-10 Mon 05:04:40:500.509 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:40:500.531 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:45:555.983 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-11-10 Mon 05:04:45:556.047 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-11-10 Mon 05:04:50:588.644 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-11-10 Mon 05:04:55:593.510 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:55:631.016 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095593418  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.33:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-11-10 Mon 05:04:55:631.055 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:593.562 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-11-10 Mon 05:04:55:631.094 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: -(-1):EvTcpConnectFail
2025-11-10 Mon 05:04:55:631.143 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10bf5f0
2025-11-10 Mon 05:04:55:631.150 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.180 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.196 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10bfca0
2025-11-10 Mon 05:04:55:631.202 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.211 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.221 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10b91d0
2025-11-10 Mon 05:04:55:631.226 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.235 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.245 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c0340
2025-11-10 Mon 05:04:55:631.250 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.258 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.277 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c0870
2025-11-10 Mon 05:04:55:631.282 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.290 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.311 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c11a0
2025-11-10 Mon 05:04:55:631.317 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.325 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.335 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c1ae0
2025-11-10 Mon 05:04:55:631.341 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.349 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.359 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c2420
2025-11-10 Mon 05:04:55:631.364 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.371 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.382 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c5260
2025-11-10 Mon 05:04:55:631.387 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.395 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.404 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c3fe0
2025-11-10 Mon 05:04:55:631.409 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.417 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.427 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c5ba0
2025-11-10 Mon 05:04:55:631.432 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.440 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.449 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c64e0
2025-11-10 Mon 05:04:55:631.454 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.462 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.474 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c4920
2025-11-10 Mon 05:04:55:631.507 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.516 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.526 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c36a0
2025-11-10 Mon 05:04:55:631.531 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.539 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.548 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: RAC_Connect status: 0 0x10c2d60
2025-11-10 Mon 05:04:55:631.553 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: Connected to REDIS...

2025-11-10 Mon 05:04:55:631.561 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-11-10 Mon 05:04:55:631.647 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-11-10 Mon 05:04:55:631.686 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Connect : EvTcpConnectFail
2025-11-10 Mon 05:04:55:631.846 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-11-10 Mon 05:04:55:631.892 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Idle
2025-11-10 Mon 05:04:55:631.959 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:632.074 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095631782  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 40,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:55:632.095 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:55:632.106 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:632.126 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095631816  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-11-10 Mon 05:04:55:632.133 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:632.141 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-11-10 Mon 05:04:55:632.186 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:632.286 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095631947  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:55:632.316 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:55:632.398 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:632.979 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:632.980 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095632338  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1762751095631891 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1762751095632184 ] max_sm_queue_count = 5 ]
2025-11-10 Mon 05:04:55:633.033 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:55:633.015 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.045 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:633.072 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.085 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.101 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.114 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.132 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.151 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.168 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.182 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.186 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751095632385  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:55:633.224 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:55:633.207 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.249 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.262 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.271 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.284 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.293 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.331 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.346 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.366 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.381 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.504 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.514 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:633.544 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.563 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: SANDESH: Send FAILED: 1762751095633436  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-11-10 Mon 05:04:55:633.578 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:633.589 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:633.608 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: SANDESH: Send FAILED: 1762751095633536  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.33:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-11-10 Mon 05:04:55:633.615 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341900580608, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:633.565 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.710 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.726 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.750 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.787 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.810 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341887985408, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:633.810 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.842 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341887985408, Pid 1]: SANDESH: Send FAILED: 1762751095633769  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description = 10.0.0.38:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-11-10 Mon 05:04:55:633.851 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341887985408, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:633.854 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.885 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:633.907 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.917 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.931 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.940 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.953 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.962 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.974 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:633.983 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:633.999 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-11-10 Mon 05:04:55:634.008 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-11-10 Mon 05:04:55:634.052 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:634.079 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:634.094 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341913175808, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-11-10 Mon 05:04:55:634.131 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341913175808, Pid 1]: SANDESH: Send FAILED: 1762751095634071  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-11-10 Mon 05:04:55:634.139 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341913175808, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:55:634.095 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:634.357 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:55:634.370 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-11-10 Mon 05:04:56:632.024 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-11-10 Mon 05:04:56:632.340 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086
2025-11-10 Mon 05:04:56:632.485 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:56:632.530 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751096632122  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-11-10 Mon 05:04:56:632.557 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-11-10 Mon 05:04:56:632.572 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-11-10 Mon 05:04:56:632.776 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SANDESH: Send FAILED: 1762751096632468  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:56:632.806 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-11-10 Mon 05:04:56:634.668 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:41256::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-11-10 Mon 05:04:56:634.696 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: 10.0.0.38:41256::10.0.0.50:8086(-1) OnSessionEvent TCP Connected
2025-11-10 Mon 05:04:56:634.705 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: 10.0.0.38:41256::10.0.0.50:8086(-1):EvTcpConnected
2025-11-10 Mon 05:04:56:634.754 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-11-10 Mon 05:04:56:634.791 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-11-10 Mon 05:04:56:634.845 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: ClientInit
2025-11-10 Mon 05:04:56:634.882 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4678-1.:contrail-query-engine:0:Database count 1
2025-11-10 Mon 05:04:56:635.016 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-11-10 Mon 05:04:56:635.033 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-11-10 Mon 05:04:56:635.069 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: SANDESH: Send FAILED: 1762751096634834  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-11-10 Mon 05:04:56:635.083 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-11-10 Mon 05:04:56:635.104 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-11-10 Mon 05:04:56:635.116 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-11-10 Mon 05:04:56:635.132 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-11-10 Mon 05:04:56:635.142 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-11-10 Mon 05:04:56:635.337 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: SANDESH: Send FAILED: 1762751096634998  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-11-10 Mon 05:04:56:635.359 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341810292480, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-11-10 Mon 05:04:56:637.835 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: OnMessage control in state: ClientInit
2025-11-10 Mon 05:04:56:637.882 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-11-10 Mon 05:04:56:637.892 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-11-10 Mon 05:04:56:637.916 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Received Ctrl Message with size 0
2025-11-10 Mon 05:04:56:638.059 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4678-1.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1762751050217656 collector_name =  collector_ip = 10.0.0.50:8086 collector_list= [  [ (*_iter40) = 10.0.0.33:8086,  (*_iter40) = 10.0.0.50:8086,  (*_iter40) = 10.0.0.38:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1762751095631891 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1762751095632184 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-11-10 Mon 05:04:56:638.087 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-11-10 Mon 05:04:56:638.114 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-4678-1. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.50:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.50:9042,  (*_iter6) = 10.0.0.33:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.50:6379,  (*_iter6) = 10.0.0.33:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-11-10 Mon 05:04:56:638.129 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-11-10 Mon 05:04:56:638.137 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-11-10 Mon 05:04:56:638.144 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-11-10 Mon 05:04:56:638.176 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: Established
2025-11-10 Mon 05:05:02:877.728 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: OnMessage control in state: Established
2025-11-10 Mon 05:05:02:877.804 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-11-10 Mon 05:05:02:877.816 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: Established : EvSandeshMessageRecv
2025-11-10 Mon 05:05:02:877.858 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: Received Ctrl Message with size 3
2025-11-10 Mon 05:05:02:877.876 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-11-10 Mon 05:05:02:877.890 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-11-10 Mon 05:05:02:877.904 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-11-10 Mon 05:05:02:877.911 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-11-10 Mon 05:05:25:633.411 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-11-10 Mon 05:06:25:634.023 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341904779008, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-11-10 Mon 05:07:25:634.516 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341801895680, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-11-10 Mon 05:07:40:303.886 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:39072 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-11-10 Mon 05:08:01:542.245 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:44644 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-11-10 Mon 05:08:25:636.333 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341917374208, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-11-10 Mon 05:09:25:637.241 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140341913175808, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-11-10 Mon 05:09:44:722.660 UTC  cn-jenkins-deploy-platform-ansible-os-4678-1 [Thread 140342069442688, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:38540 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254