2025-10-30 Thu 05:18:11:645.752 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: http-server-port 8091
2025-10-30 Thu 05:18:11:645.870 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Max-tasks 16
2025-10-30 Thu 05:18:11:645.880 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Max-slice 100
2025-10-30 Thu 05:18:11:645.886 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Collectors  10.0.0.254:8086
2025-10-30 Thu 05:18:11:645.891 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Collectors  10.0.0.48:8086
2025-10-30 Thu 05:18:11:645.896 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Collectors  10.0.0.49:8086
2025-10-30 Thu 05:18:11:645.914 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: ROLE             : Generator
2025-10-30 Thu 05:18:11:645.935 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-10-30 Thu 05:18:11:645.941 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-4536-3.
2025-10-30 Thu 05:18:11:645.946 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: NODE TYPE        : Database
2025-10-30 Thu 05:18:11:645.951 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-10-30 Thu 05:18:11:645.957 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-10-30 Thu 05:18:11:645.962 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-10-30 Thu 05:18:11:646.647 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: HTTP Introspect Init
2025-10-30 Thu 05:18:11:646.778 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-10-30 Thu 05:18:11:646.853 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Sandesh Http Server Port: 8091
2025-10-30 Thu 05:18:11:646.906 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-10-30 Thu 05:18:11:646.916 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-10-30 Thu 05:18:11:647.004 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Idle
2025-10-30 Thu 05:18:11:647.197 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: No Client: 1761801491647111  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:11:647.373 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-10-30 Thu 05:18:11:647.389 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-10-30 Thu 05:18:11:647.402 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.48:9042 10.0.0.49:9042 
2025-10-30 Thu 05:18:11:647.442 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvStart in state Idle
2025-10-30 Thu 05:18:11:647.524 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Disconnect
2025-10-30 Thu 05:18:11:647.595 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-10-30 Thu 05:18:11:647.784 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Connect : Start Connect timer 10.0.0.48:8086
2025-10-30 Thu 05:18:11:647.851 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:647.873 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: SANDESH: Send FAILED: 1761801491647516  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-10-30 Thu 05:18:11:647.882 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:11:647.891 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:647.967 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: SANDESH: Send FAILED: 1761801491647585  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:11:647.983 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:11:647.993 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:648.088 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: SANDESH: Send FAILED: 1761801491647643  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:11:648.103 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:11:648.112 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:648.127 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: SANDESH: Send FAILED: 1761801491647663  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-10-30 Thu 05:18:11:648.134 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:11:648.142 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:648.204 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: SANDESH: Send FAILED: 1761801491647840  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:11:648.216 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025099314944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:11:655.538 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-10-30 Thu 05:18:11:655.571 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:11:655.636 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:11:655.682 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:11:655.711 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SANDESH: Send FAILED: 1761801491655606  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-10-30 Thu 05:18:11:655.720 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:16:658.232 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-10-30 Thu 05:18:16:658.276 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:16:658.311 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:21:659.914 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-10-30 Thu 05:18:21:659.967 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:21:659.989 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:26:662.580 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-10-30 Thu 05:18:26:662.630 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:26:662.653 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:31:800.376 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-10-30 Thu 05:18:31:800.429 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:31:800.452 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:36:830.245 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-10-30 Thu 05:18:36:830.294 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:36:830.316 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:41:892.642 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-10-30 Thu 05:18:41:892.688 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-10-30 Thu 05:18:41:892.711 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:46:939.225 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-10-30 Thu 05:18:46:939.301 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-10-30 Thu 05:18:52:082.393 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-10-30 Thu 05:18:52:101.442 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024582498048, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:52:101.556 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024582498048, Pid 1]: SANDESH: Send FAILED: 1761801532101308  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-10-30 Thu 05:18:52:101.573 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024582498048, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:101.500 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-10-30 Thu 05:18:52:101.855 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: -(-1):EvTcpConnectFail
2025-10-30 Thu 05:18:52:101.892 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x19585f0
2025-10-30 Thu 05:18:52:101.902 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:101.923 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:101.941 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x1958ca0
2025-10-30 Thu 05:18:52:101.950 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:101.963 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:101.977 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x19521d0
2025-10-30 Thu 05:18:52:101.985 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:101.999 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.012 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x1959340
2025-10-30 Thu 05:18:52:102.020 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.034 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.061 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x1959870
2025-10-30 Thu 05:18:52:102.070 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.091 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.113 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195a1a0
2025-10-30 Thu 05:18:52:102.122 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.136 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.150 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195cfe0
2025-10-30 Thu 05:18:52:102.159 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.173 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.49 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.186 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195d920
2025-10-30 Thu 05:18:52:102.195 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.209 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.49 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.223 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195aae0
2025-10-30 Thu 05:18:52:102.231 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.245 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.258 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195b420
2025-10-30 Thu 05:18:52:102.266 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.278 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.293 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195bd60
2025-10-30 Thu 05:18:52:102.302 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:102.315 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:102.093 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-10-30 Thu 05:18:52:102.408 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Connect : EvTcpConnectFail
2025-10-30 Thu 05:18:52:102.650 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-10-30 Thu 05:18:52:102.791 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Idle
2025-10-30 Thu 05:18:52:102.903 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:103.079 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: SANDESH: Send FAILED: 1761801532102557  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 36,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:52:103.104 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:52:103.133 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:103.162 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: SANDESH: Send FAILED: 1761801532102608  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-10-30 Thu 05:18:52:103.172 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:103.184 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-10-30 Thu 05:18:52:103.258 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:103.369 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: SANDESH: Send FAILED: 1761801532102886  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 35 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 37,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:52:103.384 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:52:102.327 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195e260
2025-10-30 Thu 05:18:52:103.894 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:103.927 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.49 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:103.952 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195c6a0
2025-10-30 Thu 05:18:52:103.962 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:103.976 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:104.004 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195eba0
2025-10-30 Thu 05:18:52:104.013 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:104.025 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.49 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:104.039 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: RAC_Connect status: 0 0x195f4e0
2025-10-30 Thu 05:18:52:104.092 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: Connected to REDIS...

2025-10-30 Thu 05:18:52:104.107 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.49 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-10-30 Thu 05:18:52:104.655 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:104.746 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SANDESH: Send FAILED: 1761801532104472  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1761801532102788 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1761801532103256 ] max_sm_queue_count = 5 ]
2025-10-30 Thu 05:18:52:104.763 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:52:104.778 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:104.961 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SANDESH: Send FAILED: 1761801532104614  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:52:104.988 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:52:105.335 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.362 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.386 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.409 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.431 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.445 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.465 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.493 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.514 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.529 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.551 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.566 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.587 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.602 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.623 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.637 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.658 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.673 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.693 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.708 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.734 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:105.750 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.49:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:105.822 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.859 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.882 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.900 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.920 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.946 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.969 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:105.990 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.005 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.018 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.031 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.070 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:106.080 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:106.093 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:106.102 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:106.120 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:106.129 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:106.142 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-10-30 Thu 05:18:52:106.151 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-10-30 Thu 05:18:52:106.219 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:106.258 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: SANDESH: Send FAILED: 1761801532105797  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-10-30 Thu 05:18:52:106.268 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:106.277 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:106.298 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: SANDESH: Send FAILED: 1761801532105852  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description = 10.0.0.48:6379::Down.10.0.0.49:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-10-30 Thu 05:18:52:106.305 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:106.314 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:106.332 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: SANDESH: Send FAILED: 1761801532105963  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description = 10.0.0.49:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-10-30 Thu 05:18:52:106.343 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:106.351 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-10-30 Thu 05:18:52:106.368 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: SANDESH: Send FAILED: 1761801532105985  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-10-30 Thu 05:18:52:106.375 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:52:106.749 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.793 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.814 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:52:106.833 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-10-30 Thu 05:18:53:102.956 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-10-30 Thu 05:18:53:103.188 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Connect : Start Connect timer 10.0.0.254:8086
2025-10-30 Thu 05:18:53:103.296 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:53:103.325 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: SANDESH: Send FAILED: 1761801533103037  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-10-30 Thu 05:18:53:103.343 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-10-30 Thu 05:18:53:103.352 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-10-30 Thu 05:18:53:103.524 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: SANDESH: Send FAILED: 1761801533103282  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:53:103.542 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025065064192, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-10-30 Thu 05:18:53:105.396 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:47536::10.0.0.254:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-10-30 Thu 05:18:53:105.428 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: 10.0.0.49:47536::10.0.0.254:8086(-1) OnSessionEvent TCP Connected
2025-10-30 Thu 05:18:53:105.436 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: 10.0.0.49:47536::10.0.0.254:8086(-1):EvTcpConnected
2025-10-30 Thu 05:18:53:106.005 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-10-30 Thu 05:18:53:106.020 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-10-30 Thu 05:18:53:106.052 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: ClientInit
2025-10-30 Thu 05:18:53:106.067 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-4536-3.:contrail-query-engine:0:Database count 1
2025-10-30 Thu 05:18:53:106.145 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-10-30 Thu 05:18:53:106.156 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-10-30 Thu 05:18:53:106.180 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SANDESH: Send FAILED: 1761801533106045  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-10-30 Thu 05:18:53:106.188 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-10-30 Thu 05:18:53:106.206 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-10-30 Thu 05:18:53:106.214 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-10-30 Thu 05:18:53:106.226 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-10-30 Thu 05:18:53:106.233 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-10-30 Thu 05:18:53:106.347 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SANDESH: Send FAILED: 1761801533106135  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-10-30 Thu 05:18:53:106.363 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-10-30 Thu 05:18:53:494.182 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: OnMessage control in state: ClientInit
2025-10-30 Thu 05:18:53:494.260 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-10-30 Thu 05:18:53:494.271 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-10-30 Thu 05:18:53:494.296 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: Received Ctrl Message with size 0
2025-10-30 Thu 05:18:53:494.458 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-4536-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1761801491647028 collector_name =  collector_ip = 10.0.0.254:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.254:8086,  (*_iter40) = 10.0.0.49:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1761801532102788 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1761801532103256 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-10-30 Thu 05:18:53:494.500 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-10-30 Thu 05:18:53:494.528 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-4536-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.48:9042,  (*_iter6) = 10.0.0.49:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.48:6379,  (*_iter6) = 10.0.0.49:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-10-30 Thu 05:18:53:494.543 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-10-30 Thu 05:18:53:494.550 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-10-30 Thu 05:18:53:494.558 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-10-30 Thu 05:18:53:494.592 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024548914944, Pid 1]: Established
2025-10-30 Thu 05:19:03:603.281 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: OnMessage control in state: Established
2025-10-30 Thu 05:19:03:603.347 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-10-30 Thu 05:19:03:603.358 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: Established : EvSandeshMessageRecv
2025-10-30 Thu 05:19:03:603.417 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: Received Ctrl Message with size 3
2025-10-30 Thu 05:19:03:603.434 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-10-30 Thu 05:19:03:603.446 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-10-30 Thu 05:19:03:603.459 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-10-30 Thu 05:19:03:603.466 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-10-30 Thu 05:19:22:105.097 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025078322944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-10-30 Thu 05:20:22:106.240 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025086719744, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-10-30 Thu 05:21:22:107.692 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-10-30 Thu 05:22:21:232.763 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:8091::10.0.0.49:48518 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-10-30 Thu 05:22:22:108.302 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024569906944, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-10-30 Thu 05:22:40:187.724 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:8091::10.0.0.49:58506 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-10-30 Thu 05:23:22:110.216 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025082521344, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-10-30 Thu 05:24:22:111.963 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140024557311744, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0
2025-10-30 Thu 05:24:51:395.992 UTC  cn-jenkins-deploy-platform-ansible-os-4536-3 [Thread 140025242986624, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.49:8091::10.0.0.49:48844 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254