2026-06-22 Mon 05:23:51:328.593 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: http-server-port 8091 2026-06-22 Mon 05:23:51:328.662 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Max-tasks 16 2026-06-22 Mon 05:23:51:328.668 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Max-slice 100 2026-06-22 Mon 05:23:51:328.673 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Collectors 10.0.0.38:8086 2026-06-22 Mon 05:23:51:328.677 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Collectors 10.0.0.50:8086 2026-06-22 Mon 05:23:51:328.681 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Collectors 10.0.0.33:8086 2026-06-22 Mon 05:23:51:328.704 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: ROLE : Generator 2026-06-22 Mon 05:23:51:328.709 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: MODULE : contrail-query-engine 2026-06-22 Mon 05:23:51:328.713 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-6019-1. 2026-06-22 Mon 05:23:51:328.717 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: NODE TYPE : Database 2026-06-22 Mon 05:23:51:328.721 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: INSTANCE ID : 0 2026-06-22 Mon 05:23:51:328.725 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2026-06-22 Mon 05:23:51:328.730 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2026-06-22 Mon 05:23:51:331.456 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: HTTP Introspect Init 2026-06-22 Mon 05:23:51:331.559 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2026-06-22 Mon 05:23:51:331.650 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Sandesh Http Server Port: 8091 2026-06-22 Mon 05:23:51:331.701 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2026-06-22 Mon 05:23:51:331.708 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2026-06-22 Mon 05:23:51:332.064 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Idle 2026-06-22 Mon 05:23:51:332.196 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: No Client: 1782105831332142 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:23:51:332.330 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2026-06-22 Mon 05:23:51:332.342 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2026-06-22 Mon 05:23:51:332.352 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 2026-06-22 Mon 05:23:51:339.416 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvStart in state Idle 2026-06-22 Mon 05:23:51:339.496 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Disconnect 2026-06-22 Mon 05:23:51:339.565 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2026-06-22 Mon 05:23:51:339.786 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2026-06-22 Mon 05:23:51:339.842 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:339.860 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831339489 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:23:51:339.867 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:23:51:339.874 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:339.937 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831339553 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:23:51:339.952 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:23:51:339.960 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:340.026 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831339625 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:23:51:340.038 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:23:51:340.045 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:340.056 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831339643 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:23:51:340.061 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:23:51:340.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:340.106 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831339831 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:23:51:340.116 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:23:51:341.456 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2026-06-22 Mon 05:23:51:341.478 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:23:51:341.522 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:23:51:341.601 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:23:51:341.620 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782105831341504 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:23:51:341.626 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:23:56:343.972 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2026-06-22 Mon 05:23:56:344.019 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:23:56:344.054 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:01:346.484 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2026-06-22 Mon 05:24:01:346.526 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:24:01:346.544 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:06:349.846 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2026-06-22 Mon 05:24:06:349.893 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:24:06:349.912 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:11:496.081 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1003 2026-06-22 Mon 05:24:11:496.123 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:24:11:496.140 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:16:567.897 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1003 2026-06-22 Mon 05:24:16:567.935 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:24:16:567.954 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:21:699.469 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2026-06-22 Mon 05:24:21:699.518 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2026-06-22 Mon 05:24:26:746.989 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2026-06-22 Mon 05:24:31:752.347 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c2590 2026-06-22 Mon 05:24:31:752.399 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.414 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.426 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c7550 2026-06-22 Mon 05:24:31:752.430 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.436 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.444 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c7cb0 2026-06-22 Mon 05:24:31:752.448 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.454 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.460 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c85d0 2026-06-22 Mon 05:24:31:752.464 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.470 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.477 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c90f0 2026-06-22 Mon 05:24:31:752.481 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.487 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.499 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c9c10 2026-06-22 Mon 05:24:31:752.503 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.515 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ca730 2026-06-22 Mon 05:24:31:752.519 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.525 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cb2f0 2026-06-22 Mon 05:24:31:752.535 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.541 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.548 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cbdd0 2026-06-22 Mon 05:24:31:752.554 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.560 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.567 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cd390 2026-06-22 Mon 05:24:31:752.571 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.577 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.584 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cde70 2026-06-22 Mon 05:24:31:752.588 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.594 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.600 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ce950 2026-06-22 Mon 05:24:31:752.604 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.610 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.616 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cf430 2026-06-22 Mon 05:24:31:752.620 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.626 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.632 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cc8b0 2026-06-22 Mon 05:24:31:752.636 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.642 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.649 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cff10 2026-06-22 Mon 05:24:31:752.653 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:24:31:752.659 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:24:31:752.680 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2026-06-22 Mon 05:24:31:752.686 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1):EvTcpConnectFail 2026-06-22 Mon 05:24:31:752.907 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:24:31:752.936 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871752210 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:24:31:752.948 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:31:752.957 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2026-06-22 Mon 05:24:31:752.962 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Connect : EvTcpConnectFail 2026-06-22 Mon 05:24:31:753.082 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:24:31:753.121 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Idle 2026-06-22 Mon 05:24:31:753.169 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:753.250 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871753036 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 37, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:24:31:753.265 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:24:31:753.284 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:753.300 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871753065 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:24:31:753.305 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:31:753.312 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:24:31:753.363 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:753.427 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871753159 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 38, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:24:31:753.442 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:24:31:753.505 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:753.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871753462 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782105871753120 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782105871753362 ] max_sm_queue_count = 5 ] 2026-06-22 Mon 05:24:31:753.537 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:24:31:753.543 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:753.609 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871753492 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 38, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:24:31:753.620 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:24:31:754.382 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.397 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.409 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.416 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.427 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.434 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.448 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.456 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.465 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.472 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.483 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.490 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.500 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.507 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.517 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.523 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.533 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.540 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:754.556 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:754.604 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:754.630 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:754.633 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:754.695 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782105871754584 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:24:31:754.703 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:31:754.711 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:754.729 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782105871754625 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:24:31:754.734 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:31:754.643 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.175 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.186 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.204 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.226 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.238 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.247 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.256 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:755.344 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480413881920, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:755.372 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480413881920, Pid 1]: SANDESH: Send FAILED: 1782105871755218 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:24:31:755.380 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480413881920, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:31:755.801 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:755.819 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:755.857 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:755.865 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:755.876 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:755.883 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:755.918 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:755.928 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:755.940 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:24:31:755.947 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:24:31:755.962 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:756.025 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:756.071 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:756.082 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:756.091 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:24:31:756.039 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:24:31:756.547 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782105871756000 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:24:31:756.556 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:32:753.793 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:24:32:767.763 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:39926::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:24:32:767.795 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:39926::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:24:32:767.802 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:39926::10.0.0.38:8086(-1):EvTcpConnected 2026-06-22 Mon 05:24:32:767.849 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2026-06-22 Mon 05:24:32:767.953 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:24:32:767.976 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782105872753971 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:24:32:767.993 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:24:32:768.001 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:24:32:768.007 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:24:32:768.036 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit 2026-06-22 Mon 05:24:32:768.062 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 1 2026-06-22 Mon 05:24:32:768.115 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:24:32:768.123 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:24:32:768.205 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782105872767938 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 84, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:24:32:768.222 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:24:32:768.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:24:32:768.242 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:24:32:768.261 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782105872768031 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:24:32:768.268 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:24:32:768.286 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:24:32:768.294 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:24:32:768.308 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:24:32:768.313 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:24:32:768.383 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782105872768106 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 84, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:24:32:768.393 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:24:32:783.639 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: OnMessage control in state: ClientInit 2026-06-22 Mon 05:24:32:783.691 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2026-06-22 Mon 05:24:32:783.699 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: ClientInit : EvSandeshMessageRecv 2026-06-22 Mon 05:24:32:783.716 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Received Ctrl Message with size 0 2026-06-22 Mon 05:24:32:783.830 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782105871753120 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782105871753362 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 81 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 84, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 10 2026-06-22 Mon 05:24:32:783.855 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:24:32:783.876 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 11 2026-06-22 Mon 05:24:32:783.889 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:24:32:783.895 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:24:32:783.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:24:32:783.931 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Established 2026-06-22 Mon 05:24:39:692.098 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: OnMessage control in state: Established 2026-06-22 Mon 05:24:39:692.156 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established 2026-06-22 Mon 05:24:39:692.165 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Established : EvSandeshMessageRecv 2026-06-22 Mon 05:24:39:692.190 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Received Ctrl Message with size 3 2026-06-22 Mon 05:24:39:692.202 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0 2026-06-22 Mon 05:24:39:692.211 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0 2026-06-22 Mon 05:24:39:692.222 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0 2026-06-22 Mon 05:24:39:692.228 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:25:01:753.951 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2026-06-22 Mon 05:26:01:754.738 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2026-06-22 Mon 05:27:01:755.475 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2026-06-22 Mon 05:27:40:978.864 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:48294 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2026-06-22 Mon 05:27:53:899.960 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:39538 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 255 2026-06-22 Mon 05:28:01:756.131 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479769327168, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2026-06-22 Mon 05:29:01:756.723 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2026-06-22 Mon 05:29:36:583.550 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cc8b0 2026-06-22 Mon 05:29:36:583.622 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:583.682 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cbdd0 2026-06-22 Mon 05:29:36:583.707 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:583.833 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17ca730 2026-06-22 Mon 05:29:36:583.843 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:583.865 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cb2f0 2026-06-22 Mon 05:29:36:583.872 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:583.895 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049 2026-06-22 Mon 05:29:36:583.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c9c10 2026-06-22 Mon 05:29:36:583.907 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:584.682 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:29:36:584.721 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:29:36:584.810 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:29:36:584.879 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:29:36:584.894 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:29:36:948.476 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cf430 2026-06-22 Mon 05:29:36:948.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:948.572 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cff10 2026-06-22 Mon 05:29:36:948.582 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:948.603 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17ce950 2026-06-22 Mon 05:29:36:948.611 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:948.631 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cde70 2026-06-22 Mon 05:29:36:948.639 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:948.672 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049 2026-06-22 Mon 05:29:36:948.678 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cd390 2026-06-22 Mon 05:29:36:948.685 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:29:36:949.864 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:29:36:949.894 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:29:36:949.924 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:29:36:951.248 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:29:36:951.284 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:29:41:584.751 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:29:41:587.139 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:29:41:587.212 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:29:41:587.240 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:29:41:587.266 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:29:41:587.407 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:29:41:587.440 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:29:41:587.452 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:29:41:587.462 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:29:41:587.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:29:41:949.927 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:29:41:955.223 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:29:41:955.275 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:29:41:955.302 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:29:41:955.328 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:29:41:955.469 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:29:41:955.498 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:29:41:955.510 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:29:41:955.520 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:29:41:955.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:29:46:587.517 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:29:46:587.696 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:29:46:587.750 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:29:46:587.780 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:29:46:587.815 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:29:46:587.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:29:46:587.946 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:29:46:587.958 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:29:46:588.036 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:29:46:588.066 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:29:46:956.088 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:29:46:956.269 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:29:46:956.303 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:29:46:956.333 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:29:46:956.363 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:29:46:956.989 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:29:46:957.032 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:29:46:957.047 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:29:46:957.061 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:29:46:957.074 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:29:51:587.975 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:29:51:595.493 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:29:51:595.550 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:29:51:595.577 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:29:51:595.629 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:29:51:595.853 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cc8b0 2026-06-22 Mon 05:29:51:595.898 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:595.920 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:595.965 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cb2f0 2026-06-22 Mon 05:29:51:595.970 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:595.978 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:595.985 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cbdd0 2026-06-22 Mon 05:29:51:595.989 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:595.996 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:596.002 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c9c10 2026-06-22 Mon 05:29:51:596.007 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:596.013 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:596.020 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ca730 2026-06-22 Mon 05:29:51:596.024 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:596.031 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:596.306 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:596.337 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:596.350 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:596.358 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:596.385 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:596.452 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:596.465 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:596.473 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:596.483 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:596.490 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:596.501 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:596.508 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:596.521 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:596.534 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:596.553 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:957.066 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:29:51:957.187 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:29:51:957.226 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:29:51:957.255 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:29:51:957.285 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:29:51:957.406 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cff10 2026-06-22 Mon 05:29:51:957.414 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:957.438 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:957.463 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cf430 2026-06-22 Mon 05:29:51:957.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:957.487 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:957.494 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ce950 2026-06-22 Mon 05:29:51:957.499 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:957.505 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:957.511 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cde70 2026-06-22 Mon 05:29:51:957.515 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:957.521 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:957.527 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cd390 2026-06-22 Mon 05:29:51:957.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:29:51:957.537 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:29:51:957.813 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:957.827 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:957.845 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:957.857 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:957.863 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:957.873 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:957.879 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:957.889 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:957.895 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:957.915 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:29:51:957.922 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:29:51:957.979 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:957.990 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:957.999 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:29:51:958.007 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:30:01:757.253 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479769327168, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2026-06-22 Mon 05:31:01:757.814 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480409683520, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2026-06-22 Mon 05:31:50:308.118 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c90f0 2026-06-22 Mon 05:31:50:308.171 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:308.223 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c85d0 2026-06-22 Mon 05:31:50:308.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:308.259 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c7cb0 2026-06-22 Mon 05:31:50:308.271 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:308.292 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c7550 2026-06-22 Mon 05:31:50:308.300 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:308.323 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049 2026-06-22 Mon 05:31:50:308.329 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c2590 2026-06-22 Mon 05:31:50:308.335 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:308.607 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:31:50:308.633 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:31:50:308.644 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:31:50:308.654 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:31:50:308.667 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:31:50:320.918 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:39926::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2026-06-22 Mon 05:31:50:320.942 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:39926::10.0.0.38:8086(-1):EvTcpClose 2026-06-22 Mon 05:31:50:320.987 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpClose in state Established 2026-06-22 Mon 05:31:50:320.995 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Established : EvTcpClose 2026-06-22 Mon 05:31:50:321.263 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086 2026-06-22 Mon 05:31:50:321.345 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:321.507 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310321074 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Established successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = cn-jenkins-deploy-platform-ansible-os-6019-1. collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 390665 calls = 45 average_bytes = 8681 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 30 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 144, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 46, ] ] ] 2026-06-22 Mon 05:31:50:321.532 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:321.541 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:321.560 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310321116 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:31:50:321.566 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:50:321.572 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpDeleteSession in state Connect 2026-06-22 Mon 05:31:50:321.599 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:321.754 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310321327 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 390665 calls = 45 average_bytes = 8681 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 30 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 4 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 144, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 20, _iter59->first = sent _iter59->second = 46, ] ] ] 2026-06-22 Mon 05:31:50:321.780 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:325.746 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:45642::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:31:50:325.774 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45642::10.0.0.33:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:31:50:325.783 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45642::10.0.0.33:8086(-1):EvTcpConnected 2026-06-22 Mon 05:31:50:326.350 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:31:50:326.368 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:31:50:326.400 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: ClientInit 2026-06-22 Mon 05:31:50:326.415 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 2 2026-06-22 Mon 05:31:50:326.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:50:326.488 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:50:326.506 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106310326394 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:31:50:326.512 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:50:326.518 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:50:326.523 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:31:50:326.544 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:50:326.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:326.638 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106310326469 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 390665 calls = 45 average_bytes = 8681 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 30 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 145, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 46, ] ] ] 2026-06-22 Mon 05:31:50:326.657 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:329.980 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17ca730 2026-06-22 Mon 05:31:50:330.013 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:330.121 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cbdd0 2026-06-22 Mon 05:31:50:330.136 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:330.166 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cb2f0 2026-06-22 Mon 05:31:50:330.182 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:330.211 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cc8b0 2026-06-22 Mon 05:31:50:330.223 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:330.252 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049 2026-06-22 Mon 05:31:50:330.258 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17c9c10 2026-06-22 Mon 05:31:50:330.267 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:330.376 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:50:330.405 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:50:330.426 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106310330310 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.50:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:31:50:330.435 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:50:330.458 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:31:50:330.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:31:50:330.578 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:31:50:331.295 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:31:50:331.322 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:31:50:392.183 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: OnMessage control in state: ClientInit 2026-06-22 Mon 05:31:50:392.240 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2026-06-22 Mon 05:31:50:392.249 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvSandeshMessageRecv 2026-06-22 Mon 05:31:50:392.267 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Received Ctrl Message with size 0 2026-06-22 Mon 05:31:50:392.441 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 390665 calls = 45 average_bytes = 8681 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 63 dequeues = 63 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 71 dequeues = 71 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Established state_since = 1782105872783930 last_state = Established last_event = scm::EvSandeshSend last_event_at = 1782106261757862 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 43 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 365316 calls = 42 average_bytes = 8698 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 139 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 30 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 145, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 23, _iter59->first = sent _iter59->second = 46, ] ] max_sm_queue_count = 5 proxy seq 42 2026-06-22 Mon 05:31:50:392.483 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:31:50:392.516 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.38:6379::Down.10.0.0.50:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 21 2026-06-22 Mon 05:31:50:392.559 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:31:50:392.600 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. table_info= [ [ ] ] errors= [ write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [ [ ] ] cql_stats= [ requests_one_minute_rate = 0.4 stats= [ total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [ connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] proxy seq 8 2026-06-22 Mon 05:31:50:392.611 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:31:50:392.621 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:31:50:392.665 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Established 2026-06-22 Mon 05:31:50:436.643 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cde70 2026-06-22 Mon 05:31:50:448.346 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:448.415 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: CallbackProcess: received NULL reply from redis src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1049 2026-06-22 Mon 05:31:50:448.429 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cd390 2026-06-22 Mon 05:31:50:448.437 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:448.578 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cf430 2026-06-22 Mon 05:31:50:448.589 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:448.616 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17cff10 2026-06-22 Mon 05:31:50:448.624 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:448.642 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Disconnect status: -1 0x17ce950 2026-06-22 Mon 05:31:50:448.660 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnDown.. DOWN.. Reconnect..2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1016 2026-06-22 Mon 05:31:50:448.703 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45642::10.0.0.33:8086(-1) OnSessionEvent TCP Connection Closed 2026-06-22 Mon 05:31:50:448.710 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45642::10.0.0.33:8086(-1):EvTcpClose 2026-06-22 Mon 05:31:50:448.861 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:31:50:448.881 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:31:50:448.915 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpClose in state Established 2026-06-22 Mon 05:31:50:449.170 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Established : EvTcpClose 2026-06-22 Mon 05:31:50:449.392 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2026-06-22 Mon 05:31:50:449.478 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:449.508 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310448762 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Up description = Established ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:50:449.517 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:50:449.528 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:449.642 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310449238 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Established successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = cn-jenkins-deploy-platform-ansible-os-6019-3. collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 157, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:50:449.661 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:449.669 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:449.683 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310449262 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:50:449.688 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:50:449.694 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpDeleteSession in state Connect 2026-06-22 Mon 05:31:50:449.720 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:50:449.805 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106310449449 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 157, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:50:449.819 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:449.852 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:31:50:449.872 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:31:50:449.884 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:31:50:449.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2026-06-22 Mon 05:31:50:449.906 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1):EvTcpConnectFail 2026-06-22 Mon 05:31:50:449.933 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2026-06-22 Mon 05:31:50:449.942 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Connect : EvTcpConnectFail 2026-06-22 Mon 05:31:50:450.016 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:31:50:450.035 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Idle 2026-06-22 Mon 05:31:50:450.089 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:50:450.195 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: SANDESH: Send FAILED: 1782106310449984 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 5 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 157, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:50:450.213 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:50:450.220 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:50:450.235 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: SANDESH: Send FAILED: 1782106310450004 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:50:450.240 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:50:450.246 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:31:50:450.266 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:50:450.355 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: SANDESH: Send FAILED: 1782106310450080 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 158, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 30, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:50:450.369 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:51:450.112 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:31:51:451.782 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2026-06-22 Mon 05:31:51:451.876 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:51:451.898 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106311450175 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:51:451.905 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:51:451.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:51:452.025 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106311451861 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 2 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 158, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:51:452.047 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:51:454.716 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:60750::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:31:51:454.731 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:60750::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:31:51:454.737 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:60750::10.0.0.38:8086(-1):EvTcpConnected 2026-06-22 Mon 05:31:51:460.244 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:31:51:460.263 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:31:51:460.295 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit 2026-06-22 Mon 05:31:51:460.308 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 3 2026-06-22 Mon 05:31:51:460.380 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:51:460.394 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:51:460.411 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106311460289 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:51:460.418 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:51:460.424 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:51:460.429 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:31:51:460.439 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:51:460.444 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:31:51:460.531 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106311460369 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 441230 calls = 49 average_bytes = 9004 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 159, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 53, ] ] ] 2026-06-22 Mon 05:31:51:460.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:31:51:468.146 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:60750::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2026-06-22 Mon 05:31:51:468.162 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:60750::10.0.0.38:8086(-1):EvTcpClose 2026-06-22 Mon 05:31:51:468.758 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2026-06-22 Mon 05:31:51:468.769 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: ClientInit : EvTcpClose 2026-06-22 Mon 05:31:51:468.873 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Return to idle with 1000 2026-06-22 Mon 05:31:51:468.881 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Idle 2026-06-22 Mon 05:31:51:468.925 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:51:469.014 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106311468825 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 3 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 442803 calls = 50 average_bytes = 8856 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 159, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 54, ] ] ] 2026-06-22 Mon 05:31:51:469.032 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:51:469.040 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:51:469.056 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106311468852 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:51:469.061 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:51:469.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:31:51:469.074 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:51:469.167 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106311468914 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 3 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 442803 calls = 50 average_bytes = 8856 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 159, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 37, _iter59->first = sent _iter59->second = 54, ] ] ] 2026-06-22 Mon 05:31:51:469.184 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:52:469.960 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:31:52:470.138 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086 2026-06-22 Mon 05:31:52:470.223 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:52:470.246 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106312470006 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:52:470.253 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:52:470.260 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:52:470.359 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: SANDESH: Send FAILED: 1782106312470210 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 3 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 442803 calls = 50 average_bytes = 8856 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 159, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 54, ] ] ] 2026-06-22 Mon 05:31:52:470.375 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479773525568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:52:472.348 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:45686::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:31:52:472.364 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45686::10.0.0.33:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:31:52:472.371 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:45686::10.0.0.33:8086(-1):EvTcpConnected 2026-06-22 Mon 05:31:52:472.426 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:31:52:472.452 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:31:52:472.492 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: ClientInit 2026-06-22 Mon 05:31:52:472.510 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 4 2026-06-22 Mon 05:31:52:472.589 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:52:472.597 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:52:472.615 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106312472486 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:52:472.621 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:52:472.629 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:52:472.634 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:31:52:472.653 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:52:472.665 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:31:52:472.759 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106312472576 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 442803 calls = 50 average_bytes = 8856 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 160, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 54, ] ] ] 2026-06-22 Mon 05:31:52:472.773 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:31:55:308.683 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:31:55:309.075 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:31:55:309.129 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:31:55:309.172 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:31:55:309.194 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:31:55:309.205 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:31:55:309.213 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:31:55:309.238 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:31:55:309.275 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:31:55:309.288 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:31:55:330.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:31:55:330.646 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:31:55:330.678 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:31:55:330.940 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:31:55:330.967 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:31:55:330.979 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:31:55:331.324 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:31:55:331.367 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:31:55:331.593 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:31:55:331.631 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:31:55:448.915 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:31:55:449.065 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:31:55:449.384 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:31:55:449.415 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:31:55:449.883 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:31:55:449.924 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:31:55:449.949 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:31:55:450.202 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:31:55:450.220 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:31:55:450.232 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:31:56:473.020 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: 10.0.0.33:8086 EvConnectTimerExpired in state ClientInit 2026-06-22 Mon 05:31:56:473.085 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvConnectTimerExpired in state ClientInit 2026-06-22 Mon 05:31:56:473.095 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: ClientInit : EvConnectTimerExpired 2026-06-22 Mon 05:31:56:473.302 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Return to idle with 1000 2026-06-22 Mon 05:31:56:473.323 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Idle 2026-06-22 Mon 05:31:56:473.374 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:56:473.476 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106316473184 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 4 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 444376 calls = 51 average_bytes = 8713 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 160, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44, _iter59->first = sent _iter59->second = 55, ] ] ] 2026-06-22 Mon 05:31:56:473.493 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:56:473.502 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:56:473.518 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106316473224 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:56:473.527 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:56:473.534 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:31:56:473.541 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:56:473.618 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106316473363 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 4 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 444376 calls = 51 average_bytes = 8713 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 160, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 44, _iter59->first = sent _iter59->second = 55, ] ] ] 2026-06-22 Mon 05:31:56:473.630 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:57:473.542 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:31:57:473.731 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2026-06-22 Mon 05:31:57:473.809 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:57:473.830 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782106317473603 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:57:473.845 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:57:473.853 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:57:473.944 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: SANDESH: Send FAILED: 1782106317473797 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 4 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 444376 calls = 51 average_bytes = 8713 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 160, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 55, ] ] ] 2026-06-22 Mon 05:31:57:473.957 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479777723968, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:57:475.353 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:40186::10.0.0.50:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:31:57:475.366 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:40186::10.0.0.50:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:31:57:475.378 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:40186::10.0.0.50:8086(-1):EvTcpConnected 2026-06-22 Mon 05:31:57:475.575 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:31:57:475.584 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:31:57:475.625 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: ClientInit 2026-06-22 Mon 05:31:57:475.636 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 5 2026-06-22 Mon 05:31:57:475.701 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:57:475.708 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:57:475.723 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106317475620 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:57:475.729 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:57:475.735 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:57:475.740 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:31:57:475.749 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:57:475.754 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:31:57:475.837 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106317475690 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 5 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 444376 calls = 51 average_bytes = 8713 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 161, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 49, _iter59->first = sent _iter59->second = 55, ] ] ] 2026-06-22 Mon 05:31:57:475.853 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:31:57:482.345 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:40186::10.0.0.50:8086(-1) OnSessionEvent TCP Connection Closed 2026-06-22 Mon 05:31:57:482.367 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:40186::10.0.0.50:8086(-1):EvTcpClose 2026-06-22 Mon 05:31:57:482.870 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2026-06-22 Mon 05:31:57:482.900 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvTcpClose 2026-06-22 Mon 05:31:57:483.021 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Return to idle with 1000 2026-06-22 Mon 05:31:57:483.030 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Idle 2026-06-22 Mon 05:31:57:483.083 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:57:483.215 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106317482972 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 5 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 445949 calls = 52 average_bytes = 8575 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 161, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 51, _iter59->first = sent _iter59->second = 56, ] ] ] 2026-06-22 Mon 05:31:57:483.240 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:57:483.249 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:57:483.266 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106317483005 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:57:483.272 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:57:483.278 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:31:57:483.312 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:31:57:483.393 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106317483062 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 5 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 445949 calls = 52 average_bytes = 8575 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 161, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 51, _iter59->first = sent _iter59->second = 56, ] ] ] 2026-06-22 Mon 05:31:57:483.406 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:58:483.658 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:31:58:483.892 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2026-06-22 Mon 05:31:58:483.971 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:58:483.993 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106318483721 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:58:484.001 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:31:58:484.009 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:31:58:484.119 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106318483960 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 5 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 445949 calls = 52 average_bytes = 8575 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 161, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 54, _iter59->first = sent _iter59->second = 56, ] ] ] 2026-06-22 Mon 05:31:58:484.140 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:31:58:486.094 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:43066::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:31:58:486.127 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:43066::10.0.0.38:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:31:58:486.137 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:43066::10.0.0.38:8086(-1):EvTcpConnected 2026-06-22 Mon 05:31:58:488.069 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:31:58:488.090 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:31:58:488.132 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit 2026-06-22 Mon 05:31:58:488.147 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 6 2026-06-22 Mon 05:31:58:488.220 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:58:488.228 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:31:58:488.245 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106318488126 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:31:58:488.259 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:31:58:488.266 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:58:488.271 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:31:58:488.280 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:31:58:488.285 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:31:58:488.436 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106318488209 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 445949 calls = 52 average_bytes = 8575 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 162, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 56, _iter59->first = sent _iter59->second = 56, ] ] ] 2026-06-22 Mon 05:31:58:488.451 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:32:00:309.231 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:00:309.359 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:00:309.405 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:00:309.425 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:00:309.434 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:00:309.461 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:00:309.487 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:00:309.517 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:00:309.529 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:00:309.539 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:00:330.994 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:00:331.108 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:00:331.143 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:00:331.398 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:00:331.419 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:00:331.431 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:00:331.653 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:00:331.685 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:00:331.879 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:00:331.997 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:00:449.446 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:00:449.584 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:00:449.928 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:00:449.964 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:00:450.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:00:450.290 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:00:450.318 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:00:450.491 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:00:450.512 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:00:450.576 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:01:603.382 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.38:43066::10.0.0.38:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 506 2026-06-22 Mon 05:32:01:603.416 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.38:43066::10.0.0.38:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:32:01:603.437 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:43066::10.0.0.38:8086(-1) OnSessionEvent TCP Connection Closed 2026-06-22 Mon 05:32:01:603.444 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:43066::10.0.0.38:8086(-1):EvTcpClose 2026-06-22 Mon 05:32:01:608.074 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvTcpClose in state ClientInit 2026-06-22 Mon 05:32:01:608.110 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: ClientInit : EvTcpClose 2026-06-22 Mon 05:32:01:608.217 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Return to idle with 1000 2026-06-22 Mon 05:32:01:608.225 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Idle 2026-06-22 Mon 05:32:01:608.266 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:01:608.370 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106321608174 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 164, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 58, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:01:608.390 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:01:608.398 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:01:608.414 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106321608205 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:32:01:608.419 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:01:608.426 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:32:01:608.456 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:01:608.537 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106321608256 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 164, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 58, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:01:608.551 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:01:758.948 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2026-06-22 Mon 05:32:01:758.990 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:01:759.034 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106321758830 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 119 dequeues = 119 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 151 dequeues = 151 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782106321608225 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782106321608455 ] max_sm_queue_count = 6 ] 2026-06-22 Mon 05:32:01:759.044 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:01:759.053 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:01:759.163 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106321758924 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 164, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 61, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:01:759.187 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:02:609.484 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:32:02:609.735 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086 2026-06-22 Mon 05:32:02:609.876 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:32:02:609.914 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106322609557 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:32:02:609.926 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:02:609.937 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:32:02:609.986 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2026-06-22 Mon 05:32:02:610.008 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1):EvTcpConnectFail 2026-06-22 Mon 05:32:02:610.132 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106322609852 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 34 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 164, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 63, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:02:610.159 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:02:610.172 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2026-06-22 Mon 05:32:02:610.179 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Connect : EvTcpConnectFail 2026-06-22 Mon 05:32:02:610.262 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:32:02:610.287 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Idle 2026-06-22 Mon 05:32:02:610.331 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:02:610.437 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106322610218 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 164, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 65, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:02:610.452 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:02:610.460 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:02:610.474 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106322610239 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:32:02:610.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:02:610.486 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:32:02:610.506 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:02:610.593 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106322610321 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 165, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 65, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:02:610.606 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:05:309.494 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:05:309.692 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:05:309.766 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:05:309.794 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:05:309.808 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:05:309.841 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:05:309.866 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:05:309.900 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:05:309.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:05:309.923 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:05:331.461 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:05:331.663 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:05:331.711 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:05:332.000 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:05:332.294 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:05:332.332 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:05:332.352 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:05:332.365 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:05:332.486 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:05:333.221 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:05:449.992 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:05:450.131 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:05:450.476 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:05:450.516 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:05:450.533 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:05:450.562 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:05:450.599 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:05:450.727 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:05:450.777 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:05:450.789 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:10:309.836 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:10:309.996 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:10:310.043 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:10:310.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:10:310.076 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:10:310.112 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:10:310.137 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:10:310.179 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:10:310.192 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:10:310.202 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:10:332.362 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:10:332.504 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:10:332.547 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:10:332.787 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:10:332.813 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:10:332.824 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:10:333.209 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:10:333.250 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:10:333.476 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:10:333.523 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:10:450.538 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:10:450.672 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:10:450.748 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:10:450.800 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:10:450.831 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:10:451.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:10:451.092 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:10:451.112 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:10:451.150 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:10:451.162 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:15:310.105 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:15:310.274 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:15:310.322 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:15:310.359 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:15:310.369 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:15:310.397 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:15:310.420 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:15:310.449 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:15:310.462 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:15:310.471 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:15:332.847 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:15:332.978 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:15:333.022 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:15:333.278 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:15:333.362 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:15:333.376 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:15:333.498 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:15:333.538 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:15:333.755 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:15:333.770 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:15:451.155 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:15:451.333 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:15:451.374 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:15:451.411 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:15:451.441 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:15:451.684 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:15:451.729 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:15:451.747 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:15:451.777 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:15:451.807 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:20:310.437 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:20:310.730 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:20:310.793 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:20:310.831 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:20:310.845 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:20:310.877 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:20:310.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:20:310.931 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:20:310.944 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:20:310.954 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:20:333.339 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:20:333.499 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:20:333.529 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:20:333.783 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:20:333.821 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:20:333.862 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:20:333.889 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:20:333.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:20:333.996 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:20:334.014 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:20:451.762 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:20:451.926 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:20:451.959 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:20:451.986 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:20:452.034 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:20:452.323 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:20:452.359 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:20:452.373 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:20:452.385 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:20:452.397 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:25:310.859 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:25:311.012 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:25:311.034 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:25:311.065 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:25:311.101 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:25:311.128 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:25:311.158 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:25:311.171 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:25:311.182 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:25:311.192 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:25:333.914 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:25:334.026 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:25:334.063 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:25:334.099 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:25:334.130 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:25:334.327 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:25:334.352 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:25:334.462 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:25:334.475 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:25:334.487 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:25:452.387 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:25:452.511 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:25:452.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:25:452.578 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:25:452.606 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:25:452.832 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:25:452.856 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:25:452.867 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:25:452.878 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:25:452.941 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:30:311.068 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:30:311.227 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:30:311.248 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:30:311.278 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:30:311.305 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:30:311.331 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:30:311.360 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:30:311.372 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:30:311.383 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:30:311.393 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:30:334.384 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:30:334.503 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:30:334.544 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:30:334.575 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:30:334.613 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:30:334.753 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:30:334.778 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:30:334.789 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:30:334.801 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:30:334.811 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:30:452.903 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:30:453.021 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:30:453.065 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:30:453.106 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:30:453.134 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:30:453.269 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:30:453.390 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:30:453.426 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:30:453.442 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:30:453.459 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:31:759.752 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:31:759.833 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106351759631 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 126 dequeues = 126 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 161 dequeues = 161 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782106322610286 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782106322610505 ] max_sm_queue_count = 6 ] 2026-06-22 Mon 05:32:31:759.858 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:31:759.866 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:31:759.969 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106351759722 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 165, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 68, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:31:759.982 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:32:612.396 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:32:32:612.631 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Connect : Start Connect timer 10.0.0.50:8086 2026-06-22 Mon 05:32:32:612.735 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:32:32:612.768 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106352612460 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.50:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:32:32:612.786 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:32:612.794 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:32:32:612.897 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106352612715 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.50:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 165, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 70, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:32:612.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:32:612.960 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2026-06-22 Mon 05:32:32:612.967 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1):EvTcpConnectFail 2026-06-22 Mon 05:32:32:613.215 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2026-06-22 Mon 05:32:32:613.241 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Connect : EvTcpConnectFail 2026-06-22 Mon 05:32:32:613.347 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:32:32:613.372 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Idle 2026-06-22 Mon 05:32:32:613.417 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:32:613.518 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106352613303 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 165, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 72, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:32:613.532 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:32:613.540 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:32:613.555 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106352613329 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:32:32:613.563 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:32:613.570 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:32:32:613.592 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:32:613.673 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106352613406 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 151 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 166, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 72, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:32:32:613.683 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:32:35:311.290 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:35:311.429 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:35:311.450 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:35:311.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:35:311.517 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:35:311.541 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:35:311.572 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:35:311.585 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:35:311.618 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:35:311.630 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:35:334.810 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:35:334.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:35:334.945 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:35:334.970 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:35:334.994 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:35:335.137 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:35:335.159 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:35:335.177 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:35:335.188 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:35:335.249 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:35:453.324 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:35:453.459 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:35:453.499 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:35:453.524 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:35:453.551 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:35:453.727 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:35:453.773 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:35:453.785 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:35:453.795 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:35:453.805 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:36:761.874 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:36:761.945 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106356761818 [SYS_NOTICE]: QEDbStatsUve: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. table_info= [ [ ] ] errors= [ write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [ [ ] ] cql_stats= [ requests_one_minute_rate = 0.4 stats= [ total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [ connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] ] 2026-06-22 Mon 05:32:36:761.955 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: QEDbStatsUve 2026-06-22 Mon 05:32:40:311.494 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:40:311.651 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:40:311.674 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:40:311.706 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:40:311.731 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:40:311.757 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:40:311.785 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:40:311.798 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:40:311.809 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:40:311.819 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:40:335.203 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:40:335.327 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:40:335.363 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:40:335.390 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:40:335.416 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:40:336.260 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:40:336.309 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:40:336.330 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:40:336.347 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:40:336.368 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:40:453.819 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:40:453.972 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:40:454.023 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:40:454.068 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:40:454.114 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:40:454.290 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:40:454.335 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:40:454.353 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:40:454.371 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:40:454.388 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:45:311.706 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:45:311.876 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:45:311.900 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:45:311.930 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:45:311.956 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:45:311.980 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:45:312.010 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:45:312.023 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:45:312.033 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:45:312.043 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:45:338.719 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:45:338.843 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:45:338.873 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:45:338.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:45:338.947 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:45:339.134 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:45:339.184 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:45:339.196 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:45:339.207 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:45:339.219 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:45:454.383 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:45:454.503 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:45:454.541 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:45:454.567 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:45:454.591 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:45:454.762 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:45:454.788 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:45:454.800 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:45:454.810 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:45:454.821 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:50:311.932 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:50:342.554 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c90f0 2026-06-22 Mon 05:32:50:342.591 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:50:342.626 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:50:342.653 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:50:342.680 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:50:342.707 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:50:342.740 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:50:342.765 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:50:342.793 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:50:342.827 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:50:342.858 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c85d0 2026-06-22 Mon 05:32:50:342.873 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7cb0 2026-06-22 Mon 05:32:50:342.883 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c7550 2026-06-22 Mon 05:32:50:342.894 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c2590 2026-06-22 Mon 05:32:50:342.990 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ca730 2026-06-22 Mon 05:32:50:343.004 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cb2f0 2026-06-22 Mon 05:32:50:343.015 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cbdd0 2026-06-22 Mon 05:32:50:343.055 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17c9c10 2026-06-22 Mon 05:32:50:343.068 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cc8b0 2026-06-22 Mon 05:32:50:454.829 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:50:454.961 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:50:455.017 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:50:455.059 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:50:455.102 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:50:455.215 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cf430 2026-06-22 Mon 05:32:50:455.270 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cd390 2026-06-22 Mon 05:32:50:455.286 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cde70 2026-06-22 Mon 05:32:50:455.304 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17ce950 2026-06-22 Mon 05:32:50:455.317 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: -1 0x17cff10 2026-06-22 Mon 05:32:55:343.019 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c90f0 2026-06-22 Mon 05:32:55:343.183 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c85d0 2026-06-22 Mon 05:32:55:343.226 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7cb0 2026-06-22 Mon 05:32:55:343.260 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c7550 2026-06-22 Mon 05:32:55:343.290 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c2590 2026-06-22 Mon 05:32:55:343.328 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c90f0 2026-06-22 Mon 05:32:55:343.352 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.371 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.381 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c85d0 2026-06-22 Mon 05:32:55:343.385 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.392 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.398 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c7cb0 2026-06-22 Mon 05:32:55:343.402 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.408 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.414 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c7550 2026-06-22 Mon 05:32:55:343.418 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.424 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.430 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c2590 2026-06-22 Mon 05:32:55:343.434 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.440 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.445 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ca730 2026-06-22 Mon 05:32:55:343.483 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cb2f0 2026-06-22 Mon 05:32:55:343.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cbdd0 2026-06-22 Mon 05:32:55:343.535 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17c9c10 2026-06-22 Mon 05:32:55:343.563 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cc8b0 2026-06-22 Mon 05:32:55:343.854 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ca730 2026-06-22 Mon 05:32:55:343.880 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.895 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.907 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cbdd0 2026-06-22 Mon 05:32:55:343.919 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.926 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.933 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17c9c10 2026-06-22 Mon 05:32:55:343.937 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.943 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.950 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cc8b0 2026-06-22 Mon 05:32:55:343.954 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:343.959 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:343.996 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:344.004 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:344.015 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:344.022 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:344.033 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:344.039 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:344.045 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cb2f0 2026-06-22 Mon 05:32:55:344.050 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:344.056 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:344.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:344.073 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:344.095 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:344.106 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:344.158 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:345.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:55:345.552 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106375344188 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.50:6379::Down.10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:32:55:345.560 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:55:345.777 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:345.804 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:345.826 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:345.837 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:345.899 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:345.908 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:345.918 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:345.925 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:345.936 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:345.943 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:345.960 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:345.966 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:345.979 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:347.383 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:55:347.415 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106375346001 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:32:55:347.423 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:55:347.453 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:347.468 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:347.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:347.495 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:347.502 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:347.513 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:455.321 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cf430 2026-06-22 Mon 05:32:55:455.451 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cd390 2026-06-22 Mon 05:32:55:455.485 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cde70 2026-06-22 Mon 05:32:55:455.513 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17ce950 2026-06-22 Mon 05:32:55:455.550 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RedisAsyncConnection::RAC_Reconnect initiated 0x17cff10 2026-06-22 Mon 05:32:55:455.821 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cde70 2026-06-22 Mon 05:32:55:455.833 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:455.853 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:455.864 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cf430 2026-06-22 Mon 05:32:55:455.868 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:455.874 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:455.881 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17ce950 2026-06-22 Mon 05:32:55:455.885 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:455.891 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:455.897 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cd390 2026-06-22 Mon 05:32:55:455.901 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:455.907 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:455.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: RAC_Connect status: 0 0x17cff10 2026-06-22 Mon 05:32:55:455.917 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:32:55:455.923 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2026-06-22 Mon 05:32:55:456.219 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:456.236 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:456.247 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:456.254 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:456.264 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:456.270 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:456.288 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:456.294 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:456.304 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2026-06-22 Mon 05:32:55:456.311 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2026-06-22 Mon 05:32:55:456.328 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:458.889 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:32:55:458.919 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: SANDESH: Send FAILED: 1782106375456359 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:32:55:458.927 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479756731968, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:32:55:459.131 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:459.149 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:459.159 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:32:55:459.177 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2026-06-22 Mon 05:33:01:759.930 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2026-06-22 Mon 05:33:01:760.006 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:01:760.053 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106381759831 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 137 dequeues = 137 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 175 dequeues = 175 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782106352613371 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782106375458886 ] max_sm_queue_count = 6 ] 2026-06-22 Mon 05:33:01:760.073 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:01:760.092 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:01:760.189 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: SANDESH: Send FAILED: 1782106381759913 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 226, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 79, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:01:760.203 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480426477120, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:02:616.563 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:33:02:616.825 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086 2026-06-22 Mon 05:33:02:616.919 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:33:02:616.950 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782106382616646 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.38:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:33:02:616.959 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:33:02:616.967 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:33:02:617.097 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782106382616894 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.38:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 36 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 44 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 226, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 81, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:02:617.121 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:02:617.330 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2026-06-22 Mon 05:33:02:617.346 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: -(-1):EvTcpConnectFail 2026-06-22 Mon 05:33:02:617.886 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2026-06-22 Mon 05:33:02:617.898 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Connect : EvTcpConnectFail 2026-06-22 Mon 05:33:02:618.034 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 313 2026-06-22 Mon 05:33:02:618.068 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Idle 2026-06-22 Mon 05:33:02:618.130 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:02:618.320 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: SANDESH: Send FAILED: 1782106382617970 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 226, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 83, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:02:618.343 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:02:618.353 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:02:618.368 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: SANDESH: Send FAILED: 1782106382618003 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:33:02:618.374 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:33:02:618.380 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:33:02:618.389 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:02:618.480 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: SANDESH: Send FAILED: 1782106382618118 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 227, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 83, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:02:618.494 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479765128768, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:31:760.363 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:31:760.479 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106411760208 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 144 dequeues = 144 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 185 dequeues = 185 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782106382618067 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782106382618388 ] max_sm_queue_count = 6 ] 2026-06-22 Mon 05:33:31:760.493 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:31:760.502 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:33:31:760.597 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: SANDESH: Send FAILED: 1782106411760319 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 227, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 86, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:31:760.624 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480418080320, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:32:618.205 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2026-06-22 Mon 05:33:32:618.419 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086 2026-06-22 Mon 05:33:32:618.699 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:33:32:618.725 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106412618292 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:33:32:618.732 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:33:32:618.740 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:33:32:618.861 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: SANDESH: Send FAILED: 1782106412618683 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 6 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 49 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 227, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 88, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:32:618.886 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479752533568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:33:32:620.891 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:44720::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 281 2026-06-22 Mon 05:33:32:620.913 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:44720::10.0.0.33:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:33:32:620.919 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480457302912, Pid 1]: 10.0.0.38:44720::10.0.0.33:8086(-1):EvTcpConnected 2026-06-22 Mon 05:33:32:620.968 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:33:32:621.008 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:33:32:621.041 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit 2026-06-22 Mon 05:33:32:621.057 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 7 2026-06-22 Mon 05:33:32:621.136 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:33:32:621.144 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:33:32:621.160 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106412621035 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:33:32:621.175 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:33:32:621.182 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:33:32:621.187 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:33:32:621.196 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:33:32:621.201 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:33:32:621.302 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: SANDESH: Send FAILED: 1782106412621124 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 7 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 228, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 90, _iter59->first = sent _iter59->second = 57, ] ] ] 2026-06-22 Mon 05:33:32:621.313 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480445961792, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:33:32:631.755 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: OnMessage control in state: ClientInit 2026-06-22 Mon 05:33:32:631.810 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2026-06-22 Mon 05:33:32:631.818 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: ClientInit : EvSandeshMessageRecv 2026-06-22 Mon 05:33:32:631.842 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Received Ctrl Message with size 0 2026-06-22 Mon 05:33:32:631.994 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 7 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 3464 calls = 6 average_bytes = 577 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 447522 calls = 53 average_bytes = 8443 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 144 dequeues = 144 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 11 dequeues = 11 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 185 dequeues = 185 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1782106382618067 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1782106382618388 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 43 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 2447 calls = 4 average_bytes = 611 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 365316 calls = 42 average_bytes = 8698 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 39 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 9 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 32 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 50 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 228, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 90, _iter59->first = sent _iter59->second = 57, ] ] max_sm_queue_count = 6 proxy seq 82 2026-06-22 Mon 05:33:32:632.018 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:33:32:632.035 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 49 2026-06-22 Mon 05:33:32:632.045 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:33:32:632.071 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. table_info= [ [ ] ] errors= [ write_tablespace_fails = 0 read_tablespace_fails = 0 write_table_fails = 0 read_table_fails = 0 write_column_fails = 0 write_batch_column_fails = 0 read_column_fails = 0 ] stats_info= [ [ ] ] cql_stats= [ requests_one_minute_rate = 0.4 stats= [ total_connections = 6 available_connections = 6 exceeded_pending_requests_water_mark = 0 exceeded_write_bytes_water_mark = 0 ] errors= [ connection_timeouts = 0 pending_request_timeouts = 0 request_timeouts = 0 ] ] proxy seq 9 2026-06-22 Mon 05:33:32:632.089 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:33:32:632.094 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:33:32:632.126 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479781922368, Pid 1]: Established 2026-06-22 Mon 05:34:01:760.619 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140479760930368, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2026-06-22 Mon 05:35:01:761.857 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2026-06-22 Mon 05:35:13:612.964 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvStop in state Established 2026-06-22 Mon 05:35:13:613.057 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Idle 2026-06-22 Mon 05:35:13:613.150 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2026-06-22 Mon 05:35:13:613.160 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Processing scm::EvSandeshSend in state Idle 2026-06-22 Mon 05:35:13:613.254 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: SANDESH: Send FAILED: 1782106513613137 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 7 pid = 1 http_port = 8091 start_time = 1782105831332076 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.50:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.33:8086, ] ] rx_socket_stats= [ bytes = 4481 calls = 8 average_bytes = 560 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 573980 calls = 65 average_bytes = 8830 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 13 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QEDbStatsUve [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 211 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 7 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 40 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 51 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 228, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 92, _iter59->first = sent _iter59->second = 72, ] ] ] 2026-06-22 Mon 05:35:13:613.276 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140480430675520, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:708.906 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: http-server-port 8091 2026-06-22 Mon 05:35:33:708.970 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Max-tasks 16 2026-06-22 Mon 05:35:33:708.977 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Max-slice 100 2026-06-22 Mon 05:35:33:708.982 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Collectors 10.0.0.38:8086 2026-06-22 Mon 05:35:33:708.987 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Collectors 10.0.0.50:8086 2026-06-22 Mon 05:35:33:708.990 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Collectors 10.0.0.33:8086 2026-06-22 Mon 05:35:33:709.010 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: ROLE : Generator 2026-06-22 Mon 05:35:33:709.015 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: MODULE : contrail-query-engine 2026-06-22 Mon 05:35:33:709.019 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-6019-1. 2026-06-22 Mon 05:35:33:709.023 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: NODE TYPE : Database 2026-06-22 Mon 05:35:33:709.033 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: INSTANCE ID : 0 2026-06-22 Mon 05:35:33:709.037 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2026-06-22 Mon 05:35:33:709.042 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2026-06-22 Mon 05:35:33:711.931 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: HTTP Introspect Init 2026-06-22 Mon 05:35:33:712.094 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 138 2026-06-22 Mon 05:35:33:712.182 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Sandesh Http Server Port: 8091 2026-06-22 Mon 05:35:33:712.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2026-06-22 Mon 05:35:33:712.242 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2026-06-22 Mon 05:35:33:712.568 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Idle 2026-06-22 Mon 05:35:33:712.693 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: No Client: 1782106533712641 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:35:33:712.807 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2026-06-22 Mon 05:35:33:712.819 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2026-06-22 Mon 05:35:33:712.829 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Cassandra Servers: 10.0.0.38:9042 10.0.0.50:9042 10.0.0.33:9042 2026-06-22 Mon 05:35:33:712.945 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvStart in state Idle 2026-06-22 Mon 05:35:33:713.057 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Disconnect 2026-06-22 Mon 05:35:33:713.132 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2026-06-22 Mon 05:35:33:713.303 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Connect : Start Connect timer 10.0.0.33:8086 2026-06-22 Mon 05:35:33:713.365 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:713.381 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SANDESH: Send FAILED: 1782106533713048 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:35:33:713.388 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:35:33:713.395 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:713.453 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SANDESH: Send FAILED: 1782106533713120 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:35:33:713.469 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:713.476 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:713.520 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SANDESH: Send FAILED: 1782106533713160 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.33:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:35:33:713.527 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:713.537 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:713.744 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SANDESH: Send FAILED: 1782106533713177 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:35:33:713.753 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:35:33:713.760 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:713.801 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SANDESH: Send FAILED: 1782106533713344 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.33:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:35:33:713.813 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:740.677 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2026-06-22 Mon 05:35:33:743.671 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204416538176, Pid 1]: Processing scm::EvSandeshSend in state Connect 2026-06-22 Mon 05:35:33:743.718 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204416538176, Pid 1]: SANDESH: Send FAILED: 1782106533742389 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2026-06-22 Mon 05:35:33:743.726 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204416538176, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2026-06-22 Mon 05:35:33:743.915 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:32880::10.0.0.33:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2026-06-22 Mon 05:35:33:743.937 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: 10.0.0.38:32880::10.0.0.33:8086(-1) OnSessionEvent TCP Connected 2026-06-22 Mon 05:35:33:743.944 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: 10.0.0.38:32880::10.0.0.33:8086(-1):EvTcpConnected 2026-06-22 Mon 05:35:33:743.974 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x1264540 2026-06-22 Mon 05:35:33:743.980 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:743.989 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.000 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x1269540 2026-06-22 Mon 05:35:33:744.004 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.011 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.019 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x1269df0 2026-06-22 Mon 05:35:33:744.023 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.029 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.038 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126aab0 2026-06-22 Mon 05:35:33:744.048 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.054 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.063 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126b770 2026-06-22 Mon 05:35:33:744.067 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.082 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.091 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126c430 2026-06-22 Mon 05:35:33:744.095 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.101 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.108 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126cff0 2026-06-22 Mon 05:35:33:744.112 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.119 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.126 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126dc30 2026-06-22 Mon 05:35:33:744.130 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.136 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.144 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126f4b0 2026-06-22 Mon 05:35:33:744.148 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.154 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.162 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x12700f0 2026-06-22 Mon 05:35:33:744.166 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.172 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.180 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x126e870 2026-06-22 Mon 05:35:33:744.184 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.190 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.50 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.199 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x1270d30 2026-06-22 Mon 05:35:33:744.205 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.211 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.219 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x1271970 2026-06-22 Mon 05:35:33:744.223 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.229 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.237 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x12725b0 2026-06-22 Mon 05:35:33:744.241 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.247 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.254 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: RAC_Connect status: 0 0x12731f0 2026-06-22 Mon 05:35:33:744.258 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: Connected to REDIS... 2026-06-22 Mon 05:35:33:744.264 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.33 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1028 2026-06-22 Mon 05:35:33:744.439 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:744.449 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:744.490 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:744.503 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:744.510 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:744.519 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:744.526 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:744.535 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:744.542 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:744.555 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:744.562 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:744.583 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:744.595 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:744.605 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:744.616 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:744.699 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvTcpConnected in state Connect 2026-06-22 Mon 05:35:33:744.712 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2026-06-22 Mon 05:35:33:744.733 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit 2026-06-22 Mon 05:35:33:744.748 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-6019-1.:contrail-query-engine:0:Database count 1 2026-06-22 Mon 05:35:33:744.823 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:744.830 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.847 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SANDESH: Send FAILED: 1782106533744478 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2026-06-22 Mon 05:35:33:744.853 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.860 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:744.865 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.878 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SANDESH: Send FAILED: 1782106533744578 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.50:6379::Down.10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:35:33:744.889 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.895 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:744.900 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.911 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SANDESH: Send FAILED: 1782106533744729 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.50:6379::Down.10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:35:33:744.915 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:35:33:744.921 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:744.926 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2026-06-22 Mon 05:35:33:744.942 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:744.947 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:745.022 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SANDESH: Send FAILED: 1782106533744812 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.33:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 33, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6, _iter59->first = sent _iter59->second = 0, ] ] ] 2026-06-22 Mon 05:35:33:745.035 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2026-06-22 Mon 05:35:33:745.701 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.733 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.747 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.755 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.767 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.775 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.786 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.794 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.804 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.811 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.821 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.828 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.847 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.855 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.50:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.869 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.881 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.891 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.898 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.910 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1080 2026-06-22 Mon 05:35:33:745.932 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.33:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1087 2026-06-22 Mon 05:35:33:745.953 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:745.994 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.014 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.027 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.036 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.045 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.054 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.069 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.085 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.094 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 705 2026-06-22 Mon 05:35:33:746.014 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:746.310 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:35:33:746.330 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: SANDESH: Send FAILED: 1782106533745973 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = 10.0.0.33:6379::Down. ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:35:33:746.341 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:35:33:746.348 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2026-06-22 Mon 05:35:33:746.353 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2026-06-22 Mon 05:35:33:746.367 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: SANDESH: Send FAILED: 1782106533746007 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2026-06-22 Mon 05:35:33:746.371 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2026-06-22 Mon 05:35:33:746.980 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: OnMessage control in state: ClientInit 2026-06-22 Mon 05:35:33:748.158 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2026-06-22 Mon 05:35:33:748.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: ClientInit : EvSandeshMessageRecv 2026-06-22 Mon 05:35:33:748.257 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: Received Ctrl Message with size 0 2026-06-22 Mon 05:35:33:748.395 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1.:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1782106533712578 collector_name = collector_ip = 10.0.0.33:8086 collector_list= [ [ (*_iter40) = 10.0.0.33:8086, (*_iter40) = 10.0.0.38:8086, (*_iter40) = 10.0.0.50:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 33, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 6, _iter59->first = sent _iter59->second = 0, ] ] proxy seq 5 2026-06-22 Mon 05:35:33:748.420 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:35:33:748.440 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-6019-1. process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.33:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.38:9042, (*_iter6) = 10.0.0.50:9042, (*_iter6) = 10.0.0.33:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.38:6379, (*_iter6) = 10.0.0.50:6379, (*_iter6) = 10.0.0.33:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 8 2026-06-22 Mon 05:35:33:748.450 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2026-06-22 Mon 05:35:33:748.459 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:35:33:748.465 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2026-06-22 Mon 05:35:33:748.490 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: Established 2026-06-22 Mon 05:36:33:713.404 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2026-06-22 Mon 05:37:33:714.234 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2026-06-22 Mon 05:38:33:715.152 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2026-06-22 Mon 05:39:33:715.726 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204408141376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2026-06-22 Mon 05:40:33:716.216 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2026-06-22 Mon 05:41:33:716.698 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2026-06-22 Mon 05:42:33:717.176 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2026-06-22 Mon 05:43:33:717.725 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2026-06-22 Mon 05:44:33:718.184 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204291638848, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2026-06-22 Mon 05:45:33:718.650 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204279043648, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2026-06-22 Mon 05:46:33:719.263 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204283242048, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2026-06-22 Mon 05:47:33:720.027 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2026-06-22 Mon 05:48:33:720.571 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2026-06-22 Mon 05:49:33:721.125 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204416538176, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2026-06-22 Mon 05:50:33:722.042 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2026-06-22 Mon 05:51:24:242.967 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:57236 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2026-06-22 Mon 05:51:31:738.124 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:57248 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2026-06-22 Mon 05:51:33:722.736 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2026-06-22 Mon 05:52:33:723.655 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2026-06-22 Mon 05:52:48:403.827 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:39692 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2026-06-22 Mon 05:53:14:844.514 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: StartPipeline on : Redis:10.0.0.38 Port:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 812 2026-06-22 Mon 05:53:14:844.791 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Got Query to prepare for QID a8eccc02-6dfe-11f1-b353-00000a000026 src/contrail-analytics/contrail-query-engine/query.cc 1165 2026-06-22 Mon 05:53:14:844.837 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 :0:json query is: { end_time: 1782107594800045 , enqueue_time: 1782107594844120 , query_metadata: {"enqueue_time": 1782107594844024} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "Messagetype", "ModuleId", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVNTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:14:845.000 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Chunks: 3 Need Merge: 0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 936 2026-06-22 Mon 05:53:14:845.015 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Getting Least Loaded Conn as :0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 986 2026-06-22 Mon 05:53:14:845.063 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Starting Pipeline for a8eccc02-6dfe-11f1-b353-00000a000026 , 1 conn, 16 tasks src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 994 2026-06-22 Mon 05:53:14:845.142 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 :0:json query is: { end_time: 1782107594800045 , enqueue_time: 1782107594844120 , query_metadata: {"enqueue_time": 1782107594844024} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "Messagetype", "ModuleId", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVNTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:15:068.255 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:068.288 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:068.296 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:068.303 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:068.309 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 8 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:068.334 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 8 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:068.342 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 8 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:068.353 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 8 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:068.360 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 8 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:068.369 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 8 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:068.595 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:068.700 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:068.797 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:068.903 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:068.997 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:069.093 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:069.205 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:069.297 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :1:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:069.835 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:069.849 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:069.856 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 33 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:069.966 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 33 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:069.978 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 33 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:070.005 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 33 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:070.016 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 33 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:070.038 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 33 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:070.053 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 33 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:070.074 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 33 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:070.143 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 :0:json query is: { end_time: 1782107594800045 , enqueue_time: 1782107594844120 , query_metadata: {"enqueue_time": 1782107594844024} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "Messagetype", "ModuleId", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVNTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:15:070.314 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:070.424 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:070.521 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:070.622 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:070.717 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.026 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.127 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.230 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.321 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.414 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.642 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.730 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.821 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:071.910 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:072.057 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 0 and 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:072.111 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:072.122 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 3 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:072.138 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:072.147 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 3 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:072.157 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:072.176 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 3 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:072.187 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:072.196 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 UNION between tables of sizes 3 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:15:072.203 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: a8eccc02-6dfe-11f1-b353-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:15:072.388 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :2:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:072.485 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :2:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:072.577 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :2:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.006 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.107 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.217 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.312 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.405 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.504 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.596 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.682 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.773 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.863 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:073.953 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.043 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.133 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.233 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.332 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.427 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.518 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.606 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: a8eccc02-6dfe-11f1-b353-00000a000026 ObjectVNTable :0:Column ObjectTypeName1 Table ObjectVNTable object_id default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:15:074.863 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: Will Jsonify #rows 44 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 542 2026-06-22 Mon 05:53:15:077.208 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: Did Jsonify #rows 44 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 551 2026-06-22 Mon 05:53:15:078.848 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: QE Query Result is {"progress":100, "lines":6, "count":44} src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 586 2026-06-22 Mon 05:53:15:079.183 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204295837248, Pid 1]: [SYS_INFO]: QELog: Finished: QID a8eccc02-6dfe-11f1-b353-00000a000026 Table ObjectVNTable Time(ms) 234 RedisTime(ms) 1 MergeTime(ms) 0 Rows 44 EnQ-delay0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 661 2026-06-22 Mon 05:53:15:079.285 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204295837248, Pid 1]: [SYS_INFO]: QELog: Result 1 , 1 conn src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 699 2026-06-22 Mon 05:53:15:079.323 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204295837248, Pid 1]: [SYS_INFO]: QueryPerfInfo: name = cn-jenkins-deploy-platform-ansible-os-6019-1. table = ObjectVNTable query_stats= [ qid = a8eccc02-6dfe-11f1-b353-00000a000026 where = [[{"name": "ObjectId", "value": "default-domain:ctest-AnalyticsBasicTestSanity-87061349:ctest-vn22-35009221", "op": 1, "value2": null}]] select = { "select" : ["ObjectId", "Source", "ObjectLog", "SystemLog", "Messagetype", "ModuleId", "MessageTS"] } post = time_span = 8 error = None chunks = 3 chunk_where_time = 225,0, 223,0, 224,0, chunk_select_time = 0,0, 0,0, 0,4, chunk_postproc_time = 0,0, 0,0, 0,0, chunk_merge_time = final_merge_time = 0 time = 234 rows = 44 enq_delay = 0 ] file = src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc line = 657 2026-06-22 Mon 05:53:17:938.863 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: StartPipeline on : Redis:10.0.0.38 Port:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 812 2026-06-22 Mon 05:53:17:939.124 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Got Query to prepare for QID aac52fa9-6dfe-11f1-a105-00000a000026 src/contrail-analytics/contrail-query-engine/query.cc 1165 2026-06-22 Mon 05:53:17:939.158 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 :0:json query is: { end_time: 1782107597926144 , enqueue_time: 1782107597938480 , query_metadata: {"enqueue_time": 1782107597938359} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "a929ac37-ad4f-41e1-8b7f-91ae1549d0d6", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:17:939.295 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Chunks: 4 Need Merge: 0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 936 2026-06-22 Mon 05:53:17:939.309 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Getting Least Loaded Conn as :0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 986 2026-06-22 Mon 05:53:17:939.342 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: [SYS_INFO]: QELog: Starting Pipeline for aac52fa9-6dfe-11f1-a105-00000a000026 , 1 conn, 16 tasks src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 994 2026-06-22 Mon 05:53:17:939.445 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 :0:json query is: { end_time: 1782107597926144 , enqueue_time: 1782107597938480 , query_metadata: {"enqueue_time": 1782107597938359} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "a929ac37-ad4f-41e1-8b7f-91ae1549d0d6", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:18:033.870 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:033.918 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:033.941 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.045 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.102 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.110 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.116 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.122 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.128 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.134 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.140 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.146 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.151 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.230 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 :0:json query is: { end_time: 1782107597926144 , enqueue_time: 1782107597938480 , query_metadata: {"enqueue_time": 1782107597938359} , select_fields: ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] , start_time: 1782107572388132 , table: "ObjectVMTable" , table_schema: [{"name": "MessageTS", "datatype": "int", "index": false, "suffixes": null}, {"name": "ObjectId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Source", "datatype": "string", "index": true, "suffixes": null}, {"name": "ModuleId", "datatype": "string", "index": true, "suffixes": null}, {"name": "Messagetype", "datatype": "string", "index": true, "suffixes": null}, {"name": "ObjectLog", "datatype": "string", "index": false, "suffixes": null}, {"name": "SystemLog", "datatype": "string", "index": false, "suffixes": null}] , where: [[{"name": "ObjectId", "value": "a929ac37-ad4f-41e1-8b7f-91ae1549d0d6", "op": 1, "value2": null}]] } src/contrail-analytics/contrail-query-engine/query.cc 467 2026-06-22 Mon 05:53:18:034.051 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 2 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.079 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.418 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 2 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.440 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.443 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 2 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.465 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 2 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.450 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.477 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 2 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.486 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.497 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 2 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.512 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 2 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.520 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 2 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.526 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 2 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.527 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.538 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 2 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.549 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 3 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:034.577 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 3 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:034.754 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 ObjectVMTable :2:Column ObjectTypeName1 Table ObjectVMTable object_id a929ac37-ad4f-41e1-8b7f-91ae1549d0d6 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:18:034.832 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id a929ac37-ad4f-41e1-8b7f-91ae1549d0d6 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:18:034.848 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 ObjectVMTable :2:Column ObjectTypeName1 Table ObjectVMTable object_id a929ac37-ad4f-41e1-8b7f-91ae1549d0d6 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:18:034.947 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id a929ac37-ad4f-41e1-8b7f-91ae1549d0d6 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:18:035.041 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QEQueryLog: aac52fa9-6dfe-11f1-a105-00000a000026 ObjectVMTable :1:Column ObjectTypeName1 Table ObjectVMTable object_id a929ac37-ad4f-41e1-8b7f-91ae1549d0d6 src/contrail-analytics/contrail-query-engine/select.cc 1022 2026-06-22 Mon 05:53:18:042.059 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:042.089 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:042.096 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:042.102 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:042.108 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:042.114 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:042.119 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:042.134 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:042.140 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 UNION between tables of sizes 0 and 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 59 2026-06-22 Mon 05:53:18:042.145 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204287440448, Pid 1]: [SYS_INFO]: QELog: aac52fa9-6dfe-11f1-a105-00000a000026 Resulting size of set 0 src/contrail-analytics/contrail-query-engine/set_operation.cc 66 2026-06-22 Mon 05:53:18:042.421 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: Will Jsonify #rows 5 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 542 2026-06-22 Mon 05:53:18:042.550 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: Did Jsonify #rows 5 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 551 2026-06-22 Mon 05:53:18:042.640 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: [SYS_INFO]: QELog: QE Query Result is {"progress":100, "lines":1, "count":5} src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 586 2026-06-22 Mon 05:53:18:042.907 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: Finished: QID aac52fa9-6dfe-11f1-a105-00000a000026 Table ObjectVMTable Time(ms) 103 RedisTime(ms) 0 MergeTime(ms) 0 Rows 5 EnQ-delay0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 661 2026-06-22 Mon 05:53:18:042.931 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: [SYS_INFO]: QueryPerfInfo: name = cn-jenkins-deploy-platform-ansible-os-6019-1. table = ObjectVMTable query_stats= [ qid = aac52fa9-6dfe-11f1-a105-00000a000026 where = [[{"name": "ObjectId", "value": "a929ac37-ad4f-41e1-8b7f-91ae1549d0d6", "op": 1, "value2": null}]] select = { "select" : ["ObjectId", "Source", "ObjectLog", "SystemLog", "ModuleId", "Messagetype", "MessageTS"] } post = time_span = 8 error = None chunks = 4 chunk_where_time = 94,0, 102,0, 94,0, 95,0, chunk_select_time = 0,0, 0,0, 0,0, 0,0, chunk_postproc_time = 0,0, 0,0, 0,0, 0,0, chunk_merge_time = final_merge_time = 0 time = 103 rows = 5 enq_delay = 0 ] file = src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc line = 657 2026-06-22 Mon 05:53:18:043.011 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: [SYS_INFO]: QELog: Result 1 , 1 conn src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 699 2026-06-22 Mon 05:53:33:724.179 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2026-06-22 Mon 05:54:33:724.670 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2026-06-22 Mon 05:55:33:725.181 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204424934976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2026-06-22 Mon 05:56:33:725.756 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2026-06-22 Mon 05:57:33:726.664 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204300035648, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2026-06-22 Mon 05:58:33:727.433 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204424934976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2026-06-22 Mon 05:59:33:727.940 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204403942976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2026-06-22 Mon 06:00:33:728.456 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204274845248, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 25 without seqno , total = 0 2026-06-22 Mon 06:01:33:729.009 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 26 without seqno , total = 0 2026-06-22 Mon 06:02:33:729.641 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204412339776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 27 without seqno , total = 0 2026-06-22 Mon 06:03:33:730.436 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204291638848, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 28 without seqno , total = 0 2026-06-22 Mon 06:04:33:731.013 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204379993664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 29 without seqno , total = 0 2026-06-22 Mon 06:05:33:731.509 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204429133376, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 30 without seqno , total = 0 2026-06-22 Mon 06:05:45:932.522 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:57840 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2026-06-22 Mon 06:06:33:732.024 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204424934976, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 31 without seqno , total = 0 2026-06-22 Mon 06:07:33:732.633 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204433331776, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 32 without seqno , total = 0 2026-06-22 Mon 06:07:37:689.386 UTC cn-jenkins-deploy-platform-ansible-os-6019-1 [Thread 140204440471680, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.38:8091::10.0.0.38:33098 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256