2025-05-12 Mon 02:01:41:280.042 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: http-server-port 8091 2025-05-12 Mon 02:01:41:280.143 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Max-tasks 16 2025-05-12 Mon 02:01:41:280.155 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Max-slice 100 2025-05-12 Mon 02:01:41:280.162 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Collectors 10.0.0.129:8086 2025-05-12 Mon 02:01:41:280.189 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: ROLE : Generator 2025-05-12 Mon 02:01:41:280.197 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: MODULE : contrail-query-engine 2025-05-12 Mon 02:01:41:280.204 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: SOURCE : cn-jenkins-deploy-platform-juju-k8s-1222-1 2025-05-12 Mon 02:01:41:280.211 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: NODE TYPE : Database 2025-05-12 Mon 02:01:41:280.218 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: INSTANCE ID : 0 2025-05-12 Mon 02:01:41:280.225 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: HTTP SERVER PORT : 8091 2025-05-12 Mon 02:01:41:280.232 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-05-12 Mon 02:01:41:280.992 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: HTTP Introspect Init 2025-05-12 Mon 02:01:41:281.228 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8091 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-05-12 Mon 02:01:41:281.304 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Sandesh Http Server Port: 8091 2025-05-12 Mon 02:01:41:281.345 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: NOT Writing http_port 8091TO : /tmp/contrail-query-engine.0.http_port 2025-05-12 Mon 02:01:41:281.357 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: CONNECT TO COLLECTOR: 1 2025-05-12 Mon 02:01:41:281.460 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Idle 2025-05-12 Mon 02:01:41:281.675 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: No Client: 1747015301281573 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:01:41:281.832 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: Logging: DISABLED -> ENABLED 2025-05-12 Mon 02:01:41:281.849 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-05-12 Mon 02:01:41:281.862 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Cassandra Servers: 10.0.0.129:9042 2025-05-12 Mon 02:01:41:281.955 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvStart in state Idle 2025-05-12 Mon 02:01:41:282.038 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Disconnect 2025-05-12 Mon 02:01:41:282.206 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvCollectorUpdate in state Disconnect 2025-05-12 Mon 02:01:41:282.552 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Connect : Start Connect timer 10.0.0.129:8086 2025-05-12 Mon 02:01:41:283.049 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:283.092 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015301282031 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Idle : EvStart -> Disconnect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-05-12 Mon 02:01:41:283.102 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:01:41:283.111 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:283.558 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015301282105 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:01:41:283.584 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:01:41:283.598 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:283.689 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015301282249 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Disconnect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:01:41:283.705 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:01:41:283.716 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:283.736 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015301282283 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], ] ] flag_infos= [ [ ] ] description = Number of connections:1, Expected:3 Missing: Database,Redis-Query:Query ], ] ] ] 2025-05-12 Mon 02:01:41:283.744 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:01:41:283.754 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:283.846 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015301283037 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:01:41:283.860 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:01:41:290.857 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-12 Mon 02:01:41:290.911 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:01:41:290.959 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 0 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:01:41:290.988 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:01:41:291.013 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: SANDESH: Send FAILED: 1747015301290937 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-12 Mon 02:01:41:291.021 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:01:46:294.753 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-12 Mon 02:01:46:294.803 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:01:46:294.835 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 1 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:01:51:301.125 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-12 Mon 02:01:51:301.173 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:01:51:301.201 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 2 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:01:56:302.391 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Database initialization failed src/contrail-analytics/contrail-query-engine/query.cc 997 2025-05-12 Mon 02:01:56:302.434 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:01:56:302.463 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 3 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:02:02:121.320 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: : Create/Set KEYSPACE: ContrailAnalyticsCql FAILED src/contrail-analytics/contrail-query-engine/query.cc 1004 2025-05-12 Mon 02:02:02:121.370 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:02:02:121.405 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 4 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:02:07:223.095 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table exists. will query both the tables src/contrail-analytics/contrail-query-engine/query.cc 1043 2025-05-12 Mon 02:02:07:223.183 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 5 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:02:12:319.235 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-05-12 Mon 02:02:12:319.288 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: QeInit [SYS_WARN]: QELog: initialization of database failed. retrying 6 time src/contrail-analytics/contrail-query-engine/query.cc 1065 2025-05-12 Mon 02:02:17:423.588 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: Older table does not exist. will query only the new table src/contrail-analytics/contrail-query-engine/query.cc 1037 2025-05-12 Mon 02:02:27:435.086 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:02:27:435.142 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SANDESH: Send FAILED: 1747015347435014 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-12 Mon 02:02:27:435.152 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:27:437.733 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:50204 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:27:437.819 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: -(-1) OnSessionEvent TCP Connect Failed 2025-05-12 Mon 02:02:27:437.828 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: -(-1):EvTcpConnectFail 2025-05-12 Mon 02:02:27:437.857 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: RAC_Connect status: 0 0x21b4740 2025-05-12 Mon 02:02:27:437.863 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Connected to REDIS... 2025-05-12 Mon 02:02:27:437.875 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 0 With Redis:10.0.0.129 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-12 Mon 02:02:27:437.887 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: RAC_Connect status: 0 0x2200490 2025-05-12 Mon 02:02:27:437.892 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Connected to REDIS... 2025-05-12 Mon 02:02:27:437.900 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 1 With Redis:10.0.0.129 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-12 Mon 02:02:27:437.908 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: RAC_Connect status: 0 0x2200cc0 2025-05-12 Mon 02:02:27:437.913 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Connected to REDIS... 2025-05-12 Mon 02:02:27:437.932 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 2 With Redis:10.0.0.129 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-12 Mon 02:02:27:437.941 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: RAC_Connect status: 0 0x2201540 2025-05-12 Mon 02:02:27:437.946 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Connected to REDIS... 2025-05-12 Mon 02:02:27:437.954 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 3 With Redis:10.0.0.129 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-12 Mon 02:02:27:437.962 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: RAC_Connect status: 0 0x2201dc0 2025-05-12 Mon 02:02:27:437.967 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: Connected to REDIS... 2025-05-12 Mon 02:02:27:437.975 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp.. UP 4 With Redis:10.0.0.129 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 973 2025-05-12 Mon 02:02:27:438.238 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvTcpConnectFail in state Connect 2025-05-12 Mon 02:02:27:438.268 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Connect : EvTcpConnectFail 2025-05-12 Mon 02:02:27:438.321 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-12 Mon 02:02:27:438.360 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Idle 2025-05-12 Mon 02:02:27:438.461 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:438.489 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: SANDESH: Send FAILED: 1747015347438296 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Redis-Query:Query ], ] ] ] 2025-05-12 Mon 02:02:27:438.505 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:27:438.514 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvTcpDeleteSession in state Idle 2025-05-12 Mon 02:02:27:438.550 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:438.651 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: SANDESH: Send FAILED: 1747015347438436 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 7, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:02:27:438.664 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:02:27:438.728 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:438.765 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: SANDESH: Send FAILED: 1747015347438679 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1747015347438358 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1747015347438549 ] max_sm_queue_count = 5 ] 2025-05-12 Mon 02:02:27:438.772 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:02:27:438.779 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:438.868 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: SANDESH: Send FAILED: 1747015347438717 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Idle successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 5 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 4 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 28, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 9, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:02:27:438.889 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:02:27:443.087 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:55166 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:27:447.576 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:56774 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:27:447.696 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-12 Mon 02:02:27:447.712 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-12 Mon 02:02:27:447.728 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-12 Mon 02:02:27:447.737 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-12 Mon 02:02:27:447.749 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-12 Mon 02:02:27:447.758 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-12 Mon 02:02:27:447.770 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-12 Mon 02:02:27:447.801 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-12 Mon 02:02:27:447.815 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: UP ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1025 2025-05-12 Mon 02:02:27:447.825 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: In ConnectCallbackProcess..10.0.0.129:6379 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 1032 2025-05-12 Mon 02:02:27:447.884 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:50204 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-12 Mon 02:02:27:452.874 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB0 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-12 Mon 02:02:27:452.921 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB1 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-12 Mon 02:02:27:452.933 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB2 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-12 Mon 02:02:27:452.950 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB3 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-12 Mon 02:02:27:452.960 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: [SYS_INFO]: QELog: ConnUp SetCB4 src/contrail-analytics/contrail-query-engine/QEOpServerProxy.cc 682 2025-05-12 Mon 02:02:27:453.130 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:55166 > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 314 2025-05-12 Mon 02:02:27:453.154 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:453.199 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: SANDESH: Send FAILED: 1747015347452838 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Down description = ], ] ] flag_infos= [ [ ] ] description = Collector, Redis-Query:Query connection down ], ] ] ] 2025-05-12 Mon 02:02:27:453.209 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:27:453.218 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:453.235 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: SANDESH: Send FAILED: 1747015347452914 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-12 Mon 02:02:27:453.242 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:27:454.237 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 7 2025-05-12 Mon 02:02:27:454.385 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:454.424 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: SANDESH: Send FAILED: 1747015347454261 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-12 Mon 02:02:27:454.439 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:27:454.457 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: Processing scm::EvSandeshSend in state Idle 2025-05-12 Mon 02:02:27:454.471 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: SANDESH: Send FAILED: 1747015347454271 SandeshUVECacheResp: returned = 1 period = 0 more = 0 2025-05-12 Mon 02:02:27:454.478 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: Wrong state: Idle for event: EvSandeshSend message: SandeshUVECacheResp 2025-05-12 Mon 02:02:28:438.510 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-05-12 Mon 02:02:28:438.980 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Connect : Start Connect timer 10.0.0.129:8086 2025-05-12 Mon 02:02:28:439.080 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:02:28:439.107 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: SANDESH: Send FAILED: 1747015348438773 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-12 Mon 02:02:28:439.116 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-05-12 Mon 02:02:28:439.124 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Processing scm::EvSandeshSend in state Connect 2025-05-12 Mon 02:02:28:439.235 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: SANDESH: Send FAILED: 1747015348439067 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = Connect successful_connections = 0 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 40 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshUVECacheResp [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 6 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 47, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 15, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:02:28:439.257 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897675433728, Pid 1]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-05-12 Mon 02:02:28:443.378 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:40436::10.0.0.129:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-05-12 Mon 02:02:28:443.407 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: 10.0.0.129:40436::10.0.0.129:8086(-1) OnSessionEvent TCP Connected 2025-05-12 Mon 02:02:28:443.415 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: 10.0.0.129:40436::10.0.0.129:8086(-1):EvTcpConnected 2025-05-12 Mon 02:02:28:443.483 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Processing scm::EvTcpConnected in state Connect 2025-05-12 Mon 02:02:28:443.510 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Connect : EvTcpConnected : Cancelling Connect timer 2025-05-12 Mon 02:02:28:443.554 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: ClientInit 2025-05-12 Mon 02:02:28:443.570 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Sending Ctrl Message for cn-jenkins-deploy-platform-juju-k8s-1222-1:contrail-query-engine:0:Database count 1 2025-05-12 Mon 02:02:28:443.655 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-12 Mon 02:02:28:443.664 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-05-12 Mon 02:02:28:443.685 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: SANDESH: Send FAILED: 1747015348443537 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-05-12 Mon 02:02:28:443.692 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Received UVE message in wrong state : NodeStatusUVE 2025-05-12 Mon 02:02:28:443.702 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-12 Mon 02:02:28:443.708 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-05-12 Mon 02:02:28:443.729 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Processing scm::EvSandeshSend in state ClientInit 2025-05-12 Mon 02:02:28:443.735 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-05-12 Mon 02:02:28:443.840 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: SANDESH: Send FAILED: 1747015348443646 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 40 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshUVECacheResp [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 48, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-05-12 Mon 02:02:28:443.863 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-05-12 Mon 02:02:28:444.784 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: OnMessage control in state: ClientInit 2025-05-12 Mon 02:02:28:444.838 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-05-12 Mon 02:02:28:444.849 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: ClientInit : EvSandeshMessageRecv 2025-05-12 Mon 02:02:28:444.870 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: Received Ctrl Message with size 0 2025-05-12 Mon 02:02:28:445.013 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-juju-k8s-1222-1:Database:contrail-query-engine:0 client_info= [ status = ClientInit successful_connections = 1 pid = 1 http_port = 8091 start_time = 1747015301281473 collector_name = collector_ip = 10.0.0.129:8086 collector_list= [ [ (*_iter40) = 10.0.0.129:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 13 dequeues = 13 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1747015347438358 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1747015347438549 ] msg_type_agg= [ [ _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = QELog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 40 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshUVECacheResp [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 1 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 48, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 17, _iter59->first = sent _iter59->second = 0, ] ] max_sm_queue_count = 5 proxy seq 9 2025-05-12 Mon 02:02:28:445.035 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-05-12 Mon 02:02:28:445.055 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncUVE Syncing ObjectDatabaseInfo val name = cn-jenkins-deploy-platform-juju-k8s-1222-1 process_status= [ [ [ module_id = contrail-query-engine instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.129:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = server_addrs= [ [ (*_iter6) = 10.0.0.129:9042, ] ] status = Up description = ], [ type = Redis-Query name = Query server_addrs= [ [ (*_iter6) = 10.0.0.129:6379, ] ] status = Up description = ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 9 2025-05-12 Mon 02:02:28:445.067 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-05-12 Mon 02:02:28:445.074 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncAllMaps for QEDbStats:0 period 0 cycle 0 without seqno , total = 0 2025-05-12 Mon 02:02:28:445.081 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:0 period 60 cycle 0 without seqno , total = 0 2025-05-12 Mon 02:02:28:445.103 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: Established 2025-05-12 Mon 02:02:32:736.264 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:52456 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:41:165.156 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:50468 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:49:062.619 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:53060 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:54:104.139 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:53076 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:02:57:439.450 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897683830528, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 1 without seqno , total = 0 2025-05-12 Mon 02:02:58:586.508 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:60030 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:03:57:440.434 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897650243328, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 2 without seqno , total = 0 2025-05-12 Mon 02:04:25:440.323 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:42350 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:04:28:381.394 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:42358 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:04:54:404.512 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:50148 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:04:57:443.250 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897688028928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 3 without seqno , total = 0 2025-05-12 Mon 02:05:57:444.894 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 4 without seqno , total = 0 2025-05-12 Mon 02:06:45:060.873 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:33050 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:06:57:446.813 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 5 without seqno , total = 0 2025-05-12 Mon 02:07:57:447.884 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897658640128, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 6 without seqno , total = 0 2025-05-12 Mon 02:08:57:449.098 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897667036928, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 7 without seqno , total = 0 2025-05-12 Mon 02:09:24:235.970 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:46692 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:09:27:096.520 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:33402 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:09:32:191.639 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:33416 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:09:57:450.647 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 8 without seqno , total = 0 2025-05-12 Mon 02:10:57:451.183 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139896673003264, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 9 without seqno , total = 0 2025-05-12 Mon 02:11:57:453.015 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897671235328, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 10 without seqno , total = 0 2025-05-12 Mon 02:12:23:217.523 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:48548 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:12:57:455.308 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897671235328, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 11 without seqno , total = 0 2025-05-12 Mon 02:13:57:457.731 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897683830528, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 12 without seqno , total = 0 2025-05-12 Mon 02:14:57:458.843 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897629259520, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 13 without seqno , total = 0 2025-05-12 Mon 02:15:01:359.128 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:37728 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:15:03:844.763 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:37738 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:15:07:934.969 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:40698 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:15:57:460.018 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897766606592, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 14 without seqno , total = 0 2025-05-12 Mon 02:16:57:460.884 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897629259520, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 15 without seqno , total = 0 2025-05-12 Mon 02:17:57:462.400 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897775003392, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 16 without seqno , total = 0 2025-05-12 Mon 02:18:09:674.524 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:45784 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:18:57:463.642 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897629259520, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 17 without seqno , total = 0 2025-05-12 Mon 02:19:54:821.426 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:43682 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:19:57:465.345 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897762408192, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 18 without seqno , total = 0 2025-05-12 Mon 02:20:20:551.783 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:59390 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:20:24:602.117 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:59396 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:20:27:384.400 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:40302 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:20:53:182.783 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:44704 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:20:57:470.210 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897679632128, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 19 without seqno , total = 0 2025-05-12 Mon 02:21:19:852.824 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:42386 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-05-12 Mon 02:21:57:472.052 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897770804992, Pid 1]: SyncAllMaps for UserDefinedLogStatistic:2 period 60 cycle 20 without seqno , total = 0 2025-05-12 Mon 02:22:44:355.167 UTC cn-jenkins-deploy-platform-juju-k8s-1222-1 [Thread 139897922865280, Pid 1]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.129:8091::10.0.0.129:58346 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256