2025-08-18 Mon 05:04:40:782.803 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: http-server-port 8091
2025-08-18 Mon 05:04:40:782.919 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Max-tasks 16
2025-08-18 Mon 05:04:40:782.929 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Max-slice 100
2025-08-18 Mon 05:04:40:782.935 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Collectors  10.0.0.254:8086
2025-08-18 Mon 05:04:40:782.940 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Collectors  10.0.0.38:8086
2025-08-18 Mon 05:04:40:782.945 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Collectors  10.0.0.48:8086
2025-08-18 Mon 05:04:40:782.964 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: ROLE             : Generator
2025-08-18 Mon 05:04:40:782.993 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: MODULE           : contrail-query-engine
2025-08-18 Mon 05:04:40:782.999 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: SOURCE           : cn-jenkins-deploy-platform-ansible-os-3874-3.
2025-08-18 Mon 05:04:40:783.012 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: NODE TYPE        : Database
2025-08-18 Mon 05:04:40:783.018 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: INSTANCE ID      : 0
2025-08-18 Mon 05:04:40:783.023 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: HTTP SERVER PORT : 8091
2025-08-18 Mon 05:04:40:783.028 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0
2025-08-18 Mon 05:04:40:783.973 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: HTTP Introspect Init
2025-08-18 Mon 05:04:40:784.119 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091  Initialization complete src/contrail-common/io/tcp_server.cc 137
2025-08-18 Mon 05:04:40:784.194 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Sandesh Http Server Port: 8091
2025-08-18 Mon 05:04:40:784.250 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port
2025-08-18 Mon 05:04:40:784.260 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1
2025-08-18 Mon 05:04:40:784.363 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Idle
2025-08-18 Mon 05:04:40:784.551 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: No Client: 1755493480784462  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 0,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:04:40:784.868 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED
2025-08-18 Mon 05:04:40:784.908 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ]
2025-08-18 Mon 05:04:40:784.921 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Cassandra Servers: 10.0.0.254:9042 10.0.0.38:9042 10.0.0.48:9042 
2025-08-18 Mon 05:04:40:784.973 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvStart in state Idle
2025-08-18 Mon 05:04:40:785.059 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Disconnect
2025-08-18 Mon 05:04:40:785.129 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect
2025-08-18 Mon 05:04:40:785.326 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Connect : Start Connect timer 10.0.0.48:8086
2025-08-18 Mon 05:04:40:785.393 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:785.415 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: SANDESH: Send FAILED: 1755493480785049  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Idle : EvStart -> Disconnect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-08-18 Mon 05:04:40:785.424 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:04:40:785.432 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:785.508 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: SANDESH: Send FAILED: 1755493480785119  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 0.0.0.0:0 collector_list= [  [ ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:04:40:785.524 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:04:40:785.533 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:785.629 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: SANDESH: Send FAILED: 1755493480785176  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:04:40:785.645 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:04:40:785.655 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:785.670 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: SANDESH: Send FAILED: 1755493480785196  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  ] ] flag_infos= [  [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ],  ] ] ]
2025-08-18 Mon 05:04:40:785.676 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:04:40:785.684 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:785.747 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: SANDESH: Send FAILED: 1755493480785382  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.48:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 1,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:04:40:785.758 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125107488512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:04:40:800.020 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-18 Mon 05:04:40:800.065 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:04:40:800.558 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:04:40:800.693 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:04:40:800.742 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: SANDESH: Send FAILED: 1755493480800104  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-18 Mon 05:04:40:800.752 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:04:45:803.213 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-18 Mon 05:04:45:803.255 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:04:45:803.291 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:04:50:804.975 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-18 Mon 05:04:50:805.041 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:04:50:805.066 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:04:55:806.433 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997
2025-08-18 Mon 05:04:55:806.596 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:04:55:806.622 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:05:00:849.964 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-18 Mon 05:05:00:850.020 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:05:00:850.043 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:05:05:887.905 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-18 Mon 05:05:05:887.957 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:05:05:887.981 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:05:10:958.949 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004
2025-08-18 Mon 05:05:10:958.993 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043
2025-08-18 Mon 05:05:10:959.026 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:05:16:000.214 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-08-18 Mon 05:05:16:000.280 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065
2025-08-18 Mon 05:05:21:021.010 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037
2025-08-18 Mon 05:05:26:029.865 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125069039360, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:05:26:029.942 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125069039360, Pid 1]: SANDESH: Send FAILED: 1755493526029771  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.48:8086,  ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-18 Mon 05:05:26:029.953 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125069039360, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:26:029.897 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed
2025-08-18 Mon 05:05:26:030.142 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: -(-1):EvTcpConnectFail
2025-08-18 Mon 05:05:26:030.175 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeae5f0
2025-08-18 Mon 05:05:26:030.182 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.203 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.216 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xea81d0
2025-08-18 Mon 05:05:26:030.221 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.230 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.239 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeaf340
2025-08-18 Mon 05:05:26:030.244 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.252 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.260 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeaeca0
2025-08-18 Mon 05:05:26:030.265 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.273 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.287 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeaf870
2025-08-18 Mon 05:05:26:030.292 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.300 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.254 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.309 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb01a0
2025-08-18 Mon 05:05:26:030.314 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.322 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.330 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb0ae0
2025-08-18 Mon 05:05:26:030.335 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.343 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.350 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb1420
2025-08-18 Mon 05:05:26:030.355 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.363 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.370 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb1d60
2025-08-18 Mon 05:05:26:030.375 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.382 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.390 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb2fe0
2025-08-18 Mon 05:05:26:030.395 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.403 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.410 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb26a0
2025-08-18 Mon 05:05:26:030.415 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.423 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.38 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.431 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb3920
2025-08-18 Mon 05:05:26:030.435 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvTcpConnectFail in state Connect
2025-08-18 Mon 05:05:26:030.436 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.481 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.490 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb4260
2025-08-18 Mon 05:05:26:030.495 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.503 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.511 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb4ba0
2025-08-18 Mon 05:05:26:030.516 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.524 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.532 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: RAC_Connect status: 0 0xeb54e0
2025-08-18 Mon 05:05:26:030.537 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: Connected to REDIS...

2025-08-18 Mon 05:05:26:030.544 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.48 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973
2025-08-18 Mon 05:05:26:030.467 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Connect : EvTcpConnectFail
2025-08-18 Mon 05:05:26:031.045 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312
2025-08-18 Mon 05:05:26:031.090 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Idle
2025-08-18 Mon 05:05:26:031.175 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.285 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526030983  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 40,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:05:26:031.302 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:05:26:031.312 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.332 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031022  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ],  ] ] ]
2025-08-18 Mon 05:05:26:031.339 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:26:031.349 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle
2025-08-18 Mon 05:05:26:031.393 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.176 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:031.451 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:031.477 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:031.489 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:031.504 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:031.517 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:031.507 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031163  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 39 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 41,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:05:26:031.545 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:05:26:031.530 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:031.641 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:031.657 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:031.625 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.668 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.48:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:031.711 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031565  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1755493526031089 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1755493526031391 ] max_sm_queue_count = 5 ]
2025-08-18 Mon 05:05:26:031.722 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:05:26:031.731 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.757 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:031.836 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:031.864 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:031.887 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031613  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 46 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 48,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:05:26:031.893 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:031.904 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:05:26:031.925 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.949 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031740  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Down description =  ],  ] ] flag_infos= [  [ ] ] description = Collector, Redis-Query:Query connection down ],  ] ] ]
2025-08-18 Mon 05:05:26:031.956 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:26:031.964 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:031.927 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:031.985 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: SANDESH: Send FAILED: 1755493526031827  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.254:6379::Down.10.0.0.38:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-18 Mon 05:05:26:032.009 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140124406908672, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:26:032.048 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.060 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.074 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.082 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.095 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.104 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.115 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.124 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.136 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.145 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.254:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.164 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.200 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.216 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.228 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:032.233 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.291 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.271 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SANDESH: Send FAILED: 1755493526032191  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description = 10.0.0.38:6379::Down. ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-18 Mon 05:05:26:032.330 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.357 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.370 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.379 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.390 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.399 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.411 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.420 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.431 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025
2025-08-18 Mon 05:05:26:032.444 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.38:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032
2025-08-18 Mon 05:05:26:032.461 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.342 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:26:032.490 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.496 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshSend in state Idle
2025-08-18 Mon 05:05:26:032.511 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.534 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SANDESH: Send FAILED: 1755493526032479  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 0.0.0.0:0,  ] ] status = Down description = Connect : EvTcpConnectFail ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-18 Mon 05:05:26:032.541 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.571 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]:  [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682
2025-08-18 Mon 05:05:26:032.554 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:27:031.222 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle
2025-08-18 Mon 05:05:27:031.468 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Connect : Start Connect timer 10.0.0.38:8086
2025-08-18 Mon 05:05:27:031.582 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:05:27:031.613 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: SANDESH: Send FAILED: 1755493527031299  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-18 Mon 05:05:27:031.628 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE
2025-08-18 Mon 05:05:27:031.638 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Processing scm::EvSandeshSend in state Connect
2025-08-18 Mon 05:05:27:031.757 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: SANDESH: Send FAILED: 1755493527031569  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 86,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:05:27:031.789 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace
2025-08-18 Mon 05:05:27:033.650 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:44590::10.0.0.38:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280
2025-08-18 Mon 05:05:27:033.679 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: 10.0.0.48:44590::10.0.0.38:8086(-1) OnSessionEvent TCP Connected
2025-08-18 Mon 05:05:27:033.687 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: 10.0.0.48:44590::10.0.0.38:8086(-1):EvTcpConnected
2025-08-18 Mon 05:05:27:033.728 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvTcpConnected in state Connect
2025-08-18 Mon 05:05:27:033.742 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer
2025-08-18 Mon 05:05:27:033.775 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: ClientInit
2025-08-18 Mon 05:05:27:033.796 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-3874-3.:contrail-query-engine:0:Database count 1
2025-08-18 Mon 05:05:27:033.879 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-18 Mon 05:05:27:033.888 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE
2025-08-18 Mon 05:05:27:033.909 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SANDESH: Send FAILED: 1755493527033768  [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] ]
2025-08-18 Mon 05:05:27:033.916 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Received UVE message in wrong state : NodeStatusUVE
2025-08-18 Mon 05:05:27:033.929 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-18 Mon 05:05:27:033.936 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer
2025-08-18 Mon 05:05:27:033.947 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshSend in state ClientInit
2025-08-18 Mon 05:05:27:033.953 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace
2025-08-18 Mon 05:05:27:034.069 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SANDESH: Send FAILED: 1755493527033868  [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] ]
2025-08-18 Mon 05:05:27:034.083 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace
2025-08-18 Mon 05:05:27:038.681 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: OnMessage control in state: ClientInit
2025-08-18 Mon 05:05:27:038.727 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit
2025-08-18 Mon 05:05:27:038.736 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: ClientInit : EvSandeshMessageRecv
2025-08-18 Mon 05:05:27:038.763 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Received Ctrl Message with size 0
2025-08-18 Mon 05:05:27:038.905 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-3874-3.:Database:contrail-query-engine:0 client_info= [  status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1755493480784375 collector_name =  collector_ip = 10.0.0.38:8086 collector_list= [  [ (*_iter40) = 10.0.0.48:8086,  (*_iter40) = 10.0.0.38:8086,  (*_iter40) = 10.0.0.254:8086,  ] ] rx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] tx_socket_stats= [  bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration =  errors = 0 ] ] sm_queue_count = 0 sm_stats= [  ev_stats= [  [ [  event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ],  [  event =  enqueues = 14 dequeues = 14 enqueue_fails = 0 dequeue_fails = 0 ],  ] ] state = Idle state_since = 1755493526031089 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1755493526031391 ] msg_type_agg= [  [ _iter58->first = NodeStatusUVE [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = QELog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 84 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = SandeshModuleClientTrace [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpServerMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ],  _iter58->first = TcpSessionMessageLog [  messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ],  ] ] tx_msg_agg= [  [ _iter59->first = dropped_client_send_failed _iter59->second = 0,  _iter59->first = dropped_header_write_failed _iter59->second = 0,  _iter59->first = dropped_no_client _iter59->second = 1,  _iter59->first = dropped_no_queue _iter59->second = 0,  _iter59->first = dropped_no_session _iter59->second = 0,  _iter59->first = dropped_queue_level _iter59->second = 0,  _iter59->first = dropped_rate_limited _iter59->second = 0,  _iter59->first = dropped_sending_disabled _iter59->second = 87,  _iter59->first = dropped_sending_to_syslog _iter59->second = 0,  _iter59->first = dropped_session_not_connected _iter59->second = 0,  _iter59->first = dropped_validation_failed _iter59->second = 0,  _iter59->first = dropped_write_failed _iter59->second = 0,  _iter59->first = dropped_wrong_client_sm_state _iter59->second = 18,  _iter59->first = sent _iter59->second = 0,  ] ] max_sm_queue_count = 5 proxy  seq 10
2025-08-18 Mon 05:05:27:038.937 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1
2025-08-18 Mon 05:05:27:038.961 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-ansible-os-3874-3. process_status= [  [ [  module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [  [ [  type = Collector name =  server_addrs= [  [ (*_iter6) = 10.0.0.38:8086,  ] ] status = Initializing description = Connect : EvTcpConnected ],  [  type = Database name =  server_addrs= [  [ (*_iter6) = 10.0.0.254:9042,  (*_iter6) = 10.0.0.38:9042,  (*_iter6) = 10.0.0.48:9042,  ] ] status = Up description =  ],  [  type = Redis-Query name = Query server_addrs= [  [ (*_iter6) = 10.0.0.254:6379,  (*_iter6) = 10.0.0.38:6379,  (*_iter6) = 10.0.0.48:6379,  ] ] status = Up description =  ],  ] ] flag_infos= [  [ ] ] description = Collector connection down ],  ] ] proxy  seq 11
2025-08-18 Mon 05:05:27:038.975 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1
2025-08-18 Mon 05:05:27:038.985 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0
2025-08-18 Mon 05:05:27:038.993 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-08-18 Mon 05:05:27:039.030 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: Established
2025-08-18 Mon 05:05:32:921.340 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: OnMessage control in state: Established
2025-08-18 Mon 05:05:32:921.415 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: Processing scm::EvSandeshMessageRecv in state Established
2025-08-18 Mon 05:05:32:921.425 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: Established : EvSandeshMessageRecv
2025-08-18 Mon 05:05:32:921.470 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: Received Ctrl Message with size 3
2025-08-18 Mon 05:05:32:921.484 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 11, total = 0
2025-08-18 Mon 05:05:32:921.495 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 13, total = 0
2025-08-18 Mon 05:05:32:921.508 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 with seqno 1, total = 0
2025-08-18 Mon 05:05:32:921.517 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125094893312, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0
2025-08-18 Mon 05:05:56:032.449 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0
2025-08-18 Mon 05:06:56:033.110 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125086496512, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0
2025-08-18 Mon 05:07:53:735.446 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:56770 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-08-18 Mon 05:07:56:033.661 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125090694912, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0
2025-08-18 Mon 05:08:15:557.865 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:40296 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254
2025-08-18 Mon 05:08:56:034.529 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125060646656, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0
2025-08-18 Mon 05:09:56:035.349 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125090694912, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0
2025-08-18 Mon 05:10:19:451.099 UTC  cn-jenkins-deploy-platform-ansible-os-3874-3 [Thread 140125255358592, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.48:8091::10.0.0.48:40838 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254