2025-06-12 Thu 01:50:19:409.430 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: http-server-port 8091 2025-06-12 Thu 01:50:19:409.527 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Max-tasks 16 2025-06-12 Thu 01:50:19:409.534 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Max-slice 100 2025-06-12 Thu 01:50:19:409.540 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Collectors 10.0.0.22:8086 2025-06-12 Thu 01:50:19:409.561 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: ROLE : Generator 2025-06-12 Thu 01:50:19:409.566 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-06-12 Thu 01:50:19:409.571 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-k8s-1271-1 2025-06-12 Thu 01:50:19:409.576 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: NODE TYPE : Database 2025-06-12 Thu 01:50:19:409.581 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: INSTANCE ID : 0 2025-06-12 Thu 01:50:19:409.586 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-06-12 Thu 01:50:19:409.604 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-06-12 Thu 01:50:19:410.158 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: HTTP Introspect Init 2025-06-12 Thu 01:50:19:416.626 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-06-12 Thu 01:50:19:416.771 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Sandesh Http Server Port: 8091 2025-06-12 Thu 01:50:19:416.816 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-06-12 Thu 01:50:19:416.826 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-06-12 Thu 01:50:19:416.920 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Idle 2025-06-12 Thu 01:50:19:417.188 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: No Client: 1749693019417111 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-12 Thu 01:50:19:417.335 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-06-12 Thu 01:50:19:417.350 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-06-12 Thu 01:50:19:417.360 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Cassandra Servers: 10.0.0.22:9042 2025-06-12 Thu 01:50:19:417.433 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvStart in state Idle 2025-06-12 Thu 01:50:19:417.502 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Disconnect 2025-06-12 Thu 01:50:19:417.569 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-06-12 Thu 01:50:19:417.958 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Connect : Start Connect timer 10.0.0.22:8086 2025-06-12 Thu 01:50:19:418.033 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:418.054 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SANDESH: Send FAILED: 1749693019417494 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-06-12 Thu 01:50:19:418.063 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-12 Thu 01:50:19:418.071 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:418.150 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SANDESH: Send FAILED: 1749693019417559 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-12 Thu 01:50:19:418.166 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-12 Thu 01:50:19:418.175 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:418.241 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SANDESH: Send FAILED: 1749693019417644 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-12 Thu 01:50:19:418.252 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-12 Thu 01:50:19:418.260 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:418.274 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SANDESH: Send FAILED: 1749693019417663 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-06-12 Thu 01:50:19:418.280 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-12 Thu 01:50:19:418.287 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:418.348 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SANDESH: Send FAILED: 1749693019418022 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-12 Thu 01:50:19:418.358 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-06-12 Thu 01:50:19:477.724 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:19:477.765 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:19:477.824 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:19:477.869 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656483051264, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:50:19:477.898 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656483051264, Pid 1]: SANDESH: Send FAILED: 1749693019477798 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.22:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-12 Thu 01:50:19:477.907 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656483051264, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-12 Thu 01:50:24:518.027 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:24:518.077 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:24:518.120 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:29:520.723 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:29:520.758 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:29:520.787 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:34:526.063 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:34:526.118 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:34:526.146 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:39:527.419 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:39:527.453 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:39:527.472 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:44:528.435 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:44:528.482 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:44:528.507 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:49:530.079 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-06-12 Thu 01:50:49:530.120 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:49:530.145 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:50:55:218.278 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-06-12 Thu 01:50:55:218.315 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:50:55:218.340 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 7 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:51:00:355.304 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:51:00:355.357 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 8 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:51:05:441.541 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-06-12 Thu 01:51:05:441.609 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 9 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:51:10:637.255 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-06-12 Thu 01:51:10:637.321 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 10 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-06-12 Thu 01:51:15:738.230 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-06-12 Thu 01:51:20:743.443 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-06-12 Thu 01:51:20:743.521 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SANDESH: Send FAILED: 1749693080742704 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-12 Thu 01:51:20:743.537 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-06-12 Thu 01:51:20:747.574 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:41186 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:20:749.734 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:47360::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-06-12 Thu 01:51:20:749.756 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: 10.0.0.22:47360::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-06-12 Thu 01:51:20:749.764 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: 10.0.0.22:47360::10.0.0.22:8086(-1):EvTcpConnected 2025-06-12 Thu 01:51:20:752.271 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-06-12 Thu 01:51:20:752.301 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-06-12 Thu 01:51:20:752.342 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: ClientInit 2025-06-12 Thu 01:51:20:752.360 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-k8s-1271-1:contrail-query-engine:0:Database count 1 2025-06-12 Thu 01:51:20:752.455 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-12 Thu 01:51:20:752.465 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-06-12 Thu 01:51:20:752.486 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: SANDESH: Send FAILED: 1749693080752332 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-06-12 Thu 01:51:20:752.493 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-06-12 Thu 01:51:20:752.503 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-12 Thu 01:51:20:752.509 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-06-12 Thu 01:51:20:752.533 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-12 Thu 01:51:20:752.542 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:752.740 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: SANDESH: Send FAILED: 1749693080752444 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 31 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 34, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-06-12 Thu 01:51:20:752.759 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:763.121 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: RAC_Connect status: 0 0x1182740 2025-06-12 Thu 01:51:20:763.150 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Connected to REDIS... 2025-06-12 Thu 01:51:20:763.170 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-12 Thu 01:51:20:763.184 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: RAC_Connect status: 0 0x11ce490 2025-06-12 Thu 01:51:20:763.189 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Connected to REDIS... 2025-06-12 Thu 01:51:20:763.197 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-12 Thu 01:51:20:763.206 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: RAC_Connect status: 0 0x11cecc0 2025-06-12 Thu 01:51:20:763.211 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Connected to REDIS... 2025-06-12 Thu 01:51:20:763.227 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-12 Thu 01:51:20:763.235 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: RAC_Connect status: 0 0x11cf540 2025-06-12 Thu 01:51:20:763.240 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Connected to REDIS... 2025-06-12 Thu 01:51:20:763.247 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-12 Thu 01:51:20:763.256 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: RAC_Connect status: 0 0x11cfdc0 2025-06-12 Thu 01:51:20:763.260 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: Connected to REDIS... 2025-06-12 Thu 01:51:20:763.267 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.22 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-06-12 Thu 01:51:20:763.445 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-12 Thu 01:51:20:763.471 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:763.541 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: SANDESH: Send FAILED: 1749693080763354 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = ClientInit state_since = 1749693080752340 last_state = ClientInit last_event = scm::EvSandeshSend last_event_at = 1749693080752532 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 1 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] max_sm_queue_count = 5 ] 2025-06-12 Thu 01:51:20:763.552 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:763.561 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-06-12 Thu 01:51:20:763.567 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:763.695 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: SANDESH: Send FAILED: 1749693080763420 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 39, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 1, ] ] ] 2025-06-12 Thu 01:51:20:763.713 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656466257664, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-06-12 Thu 01:51:20:768.461 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:40360 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:20:815.568 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:34872 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:20:831.852 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: OnMessage control in state: ClientInit 2025-06-12 Thu 01:51:20:831.913 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-06-12 Thu 01:51:20:831.923 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-06-12 Thu 01:51:20:831.947 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: Received Ctrl Message with size 0 2025-06-12 Thu 01:51:20:832.128 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-k8s-1271-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1749693019416931 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.22:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = ClientInit state_since = 1749693080752340 last_state = ClientInit last_event = scm::EvSandeshSend last_event_at = 1749693080752532 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 1 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 36 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 39, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 1, ] ] max_sm_queue_count = 5 proxy seq 7 2025-06-12 Thu 01:51:20:832.158 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-06-12 Thu 01:51:20:832.179 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-juju-k8s-1271-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.22:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] proxy seq 5 2025-06-12 Thu 01:51:20:832.190 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-06-12 Thu 01:51:20:832.197 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-06-12 Thu 01:51:20:832.205 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-06-12 Thu 01:51:20:832.236 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656470456064, Pid 1]: Established 2025-06-12 Thu 01:51:20:835.424 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-12 Thu 01:51:20:835.453 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-12 Thu 01:51:20:835.468 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-12 Thu 01:51:20:835.477 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-12 Thu 01:51:20:835.491 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-12 Thu 01:51:20:835.499 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-12 Thu 01:51:20:835.511 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-12 Thu 01:51:20:835.529 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-12 Thu 01:51:20:835.541 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-06-12 Thu 01:51:20:835.556 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.22:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-06-12 Thu 01:51:20:837.408 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:42244 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:20:837.515 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:41186 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-06-12 Thu 01:51:20:848.081 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-12 Thu 01:51:20:850.565 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-12 Thu 01:51:20:850.600 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-12 Thu 01:51:20:850.624 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-12 Thu 01:51:20:850.635 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-06-12 Thu 01:51:20:854.318 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:54774 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:20:854.449 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:40360 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-06-12 Thu 01:51:20:862.437 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:34872 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-06-12 Thu 01:51:20:868.200 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:54774 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-06-12 Thu 01:51:20:873.092 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:42244 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-06-12 Thu 01:51:25:663.164 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:35296 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:30:389.373 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:35304 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:34:571.522 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:35306 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:51:50:763.886 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-06-12 Thu 01:52:29:987.011 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:32924 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:52:33:046.154 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:32932 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:52:50:767.299 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656457860864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-06-12 Thu 01:52:58:724.411 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:46408 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:53:31:425.228 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:35438 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:53:50:769.570 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-06-12 Thu 01:54:50:770.169 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656444405504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-06-12 Thu 01:55:50:771.221 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655802496768, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-06-12 Thu 01:56:39:798.955 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:38260 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:56:44:524.308 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:38264 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:56:50:775.283 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-06-12 Thu 01:57:50:776.018 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655819290368, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-06-12 Thu 01:58:02:962.533 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:48626 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:58:39:035.294 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:40788 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 01:58:50:777.306 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656444405504, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-06-12 Thu 01:59:50:777.951 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656478852864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-06-12 Thu 02:00:50:779.246 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-06-12 Thu 02:01:50:780.716 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-06-12 Thu 02:02:34:543.350 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:40308 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:02:39:236.773 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:46780 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:02:50:783.826 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-06-12 Thu 02:03:12:953.116 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:44816 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:03:41:859.173 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:45494 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:03:50:785.022 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-06-12 Thu 02:04:50:786.510 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656462059264, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-06-12 Thu 02:05:50:787.335 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656487249664, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-06-12 Thu 02:06:50:787.885 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656474654464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-06-12 Thu 02:07:14:385.636 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:51776 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:07:18:767.902 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:40040 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:07:50:789.145 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656474654464, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-06-12 Thu 02:08:20:645.268 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:53232 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:08:50:790.587 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656457860864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-06-12 Thu 02:08:55:399.140 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:47692 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:09:50:791.921 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655815091968, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-06-12 Thu 02:10:50:792.647 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655810893568, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-06-12 Thu 02:11:30:320.659 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:59320 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:11:35:067.107 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:42004 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:11:50:793.761 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655827683072, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 21 without seqno , total = 0 2025-06-12 Thu 02:12:20:618.349 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:58128 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:12:47:164.771 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:37116 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:12:50:794.666 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656478852864, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 22 without seqno , total = 0 2025-06-12 Thu 02:13:13:375.728 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:54650 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:13:40:491.984 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:52408 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:13:50:795.179 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655827683072, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 23 without seqno , total = 0 2025-06-12 Thu 02:14:08:770.906 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:38418 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:14:14:351.827 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:38432 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-06-12 Thu 02:14:50:796.183 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139655827683072, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 24 without seqno , total = 0 2025-06-12 Thu 02:14:58:927.833 UTC cn-jenkins-deploy-platform-juju-k8s-1271-1 [Thread 139656635111552, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.22:8091::10.0.0.22:50812 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256