08/04/2025 02:14:56.107 7f53e9b78c88 [contrail-analytics-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/04/2025 02:14:56.107 7f53e9b78c88 [contrail-analytics-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/04/2025 02:14:56.107 7f53e9b78c88 [contrail-analytics-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/04/2025 02:14:56.108 7f53e9b78c88 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:NodeStatusUVE] map 08/04/2025 02:14:56.133 7f53e9b78c88 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 08/04/2025 02:14:56.134 7f53e1ef3438 [contrail-analytics-api] [ERROR]: Cannot write http_port 8090 to /tmp/contrail-analytics-api.0.http_port 08/04/2025 02:14:56.134 7f53e1ef3438 [contrail-analytics-api] [ERROR]: Starting Introspect on HTTP Port 8090 08/04/2025 02:14:56.134 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvStart] in state[none] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, ] description = >>, ] >> 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Initializing description = Redis Instance initialized >>, ] description = Redis-UVE:10.0.0.19:6379[Redis Instance initialized] connection down >>, ] >> 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Redis-UVE:10.0.0.19:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized] connection down >>, ] >> 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.135 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] AnalyticsApiInfoUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. analytics_node_ip = { rest_api_ip : 10.0.0.19host_ip : 10.0.0.19 } >> 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Redis-UVE:10.0.0.19:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1.:Analytics:contrail-analytics-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8090 start_time = 1754273696135069 collector_name = collector_ip = collector_list = [ 10.0.0.19:8086, ] >> sm_queue_count = 5 max_sm_queue_count = 5 >> 08/04/2025 02:14:56.136 7f53e1ef2d68 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.137 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery zk start 08/04/2025 02:14:56.145 7f53e630da20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.145 7f53e630da20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Initializing description = Redis Instance initialized >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Redis-UVE:10.0.0.19:6379[Redis Instance initialized], Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 08/04/2025 02:14:56.145 7f53e630da20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.149 7f53e626c588 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.149 7f53e626c588 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Initializing description = Connection to API Server initialized >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[Connection to API Server initialized] connection down >>, ] >> 08/04/2025 02:14:56.149 7f53e626c588 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.153 7f53e9b7ca20 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.154 7f53e9b7ca20 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Up description = Connection to API Server established >>, ] description = Zookeeper:OpServer[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/04/2025 02:14:56.154 7f53e9b7ca20 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.154 7f53e62d6b70 [contrail-analytics-api] [INFO]: Analytics Discovery listen CONNECTED 08/04/2025 02:14:56.154 7f53e62d6b70 [contrail-analytics-api] [INFO]: Analytics Discovery to publish None 08/04/2025 02:14:56.154 7f53e9bcecc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.155 7f53e9bcecc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Up description = Connection to Zookeeper re-established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/04/2025 02:14:56.155 7f53e9bcecc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.155 7f53e9bcecc0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.155 7f53e9bcecc0 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/04/2025 02:14:56.155 7f53e9bcecc0 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/04/2025 02:14:56.159 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children [] 08/04/2025 02:14:56.161 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 08/04/2025 02:14:56.161 7f53e78bfc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 08/04/2025 02:14:56.161 7f53e78bfc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 08/04/2025 02:14:56.165 7f53e78bfc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3748-1.-0 08/04/2025 02:15:00.136 7f53e62a1198 [contrail-analytics-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/04/2025 02:15:00.137 7f53e62a1198 [contrail-analytics-api] [INFO]: Session Event: TCP Connected 08/04/2025 02:15:00.137 7f53e62a1198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/04/2025 02:15:00.137 7f53e62a1198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3748-1. process_status = [ << module_id = contrail-analytics-api instance_id = 0 state = Non-Functional connection_infos = [ << type = UvePartitions name = UVE-Aggregation server_addrs = [ 10.0.0.19:6379, ] status = Up description = Not using Kafka for UVE Aggregation >>, << type = Redis-UVE name = 10.0.0.19:6379 server_addrs = [ 10.0.0.19:6379, ] status = Up >>, << type = Zookeeper name = OpServer server_addrs = [ 10.0.0.19:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.19:8082, ] status = Up description = Connection to API Server established >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [DEBUG]: Send sandesh control message. uve type count # 7 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/04/2025 02:15:00.138 7f53e62a1198 [contrail-analytics-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/04/2025 02:15:00.138 7f53e62a1978 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/04/2025 02:15:00.139 7f53e62a1978 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/04/2025 02:15:00.141 7f53e1ef2ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001017 08/04/2025 02:15:00.142 7f53e1ef2ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 0 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/04/2025 02:15:00.142 7f53e13478d0 [contrail-analytics-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/04/2025 02:15:00.143 7f53e62a1978 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/04/2025 02:15:00.144 7f53e62a1978 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/04/2025 02:15:04.681 7f53e13478d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBeoDxV12fMVvUSgMbvcZKnbWzH5iYq_W3pIvprcYLztyh-F8_a9BhVZpT4bD1PmvBSCFpB5m7zgcFeZEJ5Wblsx0dUVLsLmBHI8WDWuFOnbxLG5mpNRuood6CWwAhRgONnk5UCjUcSyF2ArJpqOsect2P8bcJSYFJJykROdZIJsr1w 08/04/2025 02:15:04.681 7f53e13478d0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:15:04.682 7f53e62a1390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1050 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:15:05.027 7f53e13478d0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBeoMDZhl2mzXE3-aruQbXYRLgXLVmp4q3IFJpcCySLjJ3Fpk59YiEMsylg1zU57BuvR8Gq2OTaMahBYu-or2_qvAFtPtlGVkO64VnJYnzv1Ma3L_DAgW5QFqcFvz8tdgYyAwK9F-UAy66ZU8xSBIeCHrCdKnWJfi9z8BQI-egIGqxg 08/04/2025 02:15:05.030 7f53e13478d0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:15:05.031 7f53e7d94828 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3557 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:15:07.483 7f53e1ef2ac8 [contrail-analytics-api] [DEBUG]: Extracted sandesh length: 0000001436 08/04/2025 02:15:07.483 7f53e1ef2ac8 [contrail-analytics-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/04/2025 02:15:07.484 7f53df66bd68 [contrail-analytics-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/04/2025 02:15:07.484 7f53df66bd68 [contrail-analytics-api] [DEBUG]: Number of uve types in sandesh control message is 3 08/04/2025 02:15:07.484 7f53df66bd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:AnalyticsApiInfoUVE] map 08/04/2025 02:15:07.484 7f53df66bd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 08/04/2025 02:15:07.484 7f53df66bd68 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/04/2025 02:15:07.484 7f53e7d94828 [contrail-analytics-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/04/2025 02:15:07.485 7f53e7d94828 [contrail-analytics-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/04/2025 02:15:10.140 7f53e62d6a20 [contrail-analytics-api] [INFO]: Analytics Discovery Watcher AlarmGenerator Children ['cn-jenkins-deploy-platform-ansible-os-3748-1.-0'] 08/04/2025 02:15:16.168 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery OpServer reconnect 08/04/2025 02:15:16.168 7f53e78bfc18 [contrail-analytics-api] [INFO]: ensure /analytics-discovery-/OpServer 08/04/2025 02:15:16.168 7f53e78bfc18 [contrail-analytics-api] [INFO]: zk state CONNECTED (CONNECTED) 08/04/2025 02:15:16.169 7f53e78bfc18 [contrail-analytics-api] [INFO]: check for /analytics-discovery-/OpServer/cn-jenkins-deploy-platform-ansible-os-3748-1.-0 08/04/2025 02:15:16.175 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3748-1.-0, data b'{"ip-address": "10.0.0.19", "instance-id": "0", "redis-ip": "10.0.0.19", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event None 08/04/2025 02:15:16.176 7f53e78bfc18 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3748-1.-0, data OrderedDict([('instance-id', '0'), ('ip-address', '10.0.0.19'), ('partitions', '{}'), ('redis-agg-db', 7), ('redis-ip', '10.0.0.19'), ('redis-port', '6379')]), event GET 08/04/2025 02:15:19.272 7f53e62d6a20 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3748-1.-0, data b'{"ip-address": "10.0.0.19", "instance-id": "0", "redis-ip": "10.0.0.19", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3748-1.-0') 08/04/2025 02:15:20.231 7f53e62d6a20 [contrail-analytics-api] [INFO]: Analytics Discovery AlarmGenerator ChildData : child cn-jenkins-deploy-platform-ansible-os-3748-1.-0, data b'{"ip-address": "10.0.0.19", "instance-id": "0", "redis-ip": "10.0.0.19", "redis-port": "6379", "redis-agg-db": 7, "partitions": "{\\"0\\": 1754273719511410, \\"1\\": 1754273719517058, \\"2\\": 1754273719521716, \\"3\\": 1754273719548899, \\"4\\": 1754273719570240, \\"5\\": 1754273719576201, \\"6\\": 1754273719586915, \\"7\\": 1754273719593735, \\"8\\": 1754273719621626, \\"9\\": 1754273719648230, \\"10\\": 1754273719660875, \\"11\\": 1754273719665107, \\"12\\": 1754273719678925, \\"13\\": 1754273719701081, \\"14\\": 1754273719730912, \\"15\\": 1754273719744210, \\"16\\": 1754273719755435, \\"17\\": 1754273719779802, \\"18\\": 1754273719802350, \\"19\\": 1754273719815799, \\"20\\": 1754273719830872, \\"21\\": 1754273719862067, \\"22\\": 1754273719882955, \\"23\\": 1754273719900815, \\"24\\": 1754273719915597, \\"25\\": 1754273719936208, \\"26\\": 1754273719963207, \\"27\\": 1754273719980669, \\"28\\": 1754273720008705, \\"29\\": 1754273720029591}"}', event WatchedEvent(type='CHANGED', state='CONNECTED', path='/analytics-discovery-/AlarmGenerator/cn-jenkins-deploy-platform-ansible-os-3748-1.-0') 08/04/2025 02:16:05.376 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBflCzdfhHIhz0QP4K9Ij6Mpq9mv-rVzRUclk70ybDgMHYtG2vmsn8b23h4crMrQWKSWH2bZxEXk1Cl5qm7675J5xtAs5luU_ab3CY87haeevcrM1e2iULqyPsJaeY5bpqusXwt1bV27zM_zJ2YnBhQkO7Kz-imDGW4bsuKv-j2aeAA 08/04/2025 02:16:05.376 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:16:05.377 7f53e629f198 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 732 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:16:05.719 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBflJ-ssOMHvBay1iahS-gQE0k8SGwz7NLvRKIEnWw3Zo-BlMZG-ekglpg7LkXC_DmobR7WXzuZF9JCmXdXdskmg_Y7D1W1BxLpld6alsQNLnAvIrgxB8dwqfKI8MWBScnHiIHpibIcnAVryOrr83NCyXFW9DBA3HAFCM89mLN3nqEo 08/04/2025 02:16:05.719 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:16:05.720 7f53e62d6eb8 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 1046 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:16:50.985 7f53e630f438 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 08/04/2025 02:16:53.155 7f53e630f438 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map 08/04/2025 02:17:06.071 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBgihbq6U4yRy85SVtDNLiWuHYakpXwMG_L5ZgQsPCADfsjIy2AWasnPdpdVhLf1dMsB8A29K8z5QBFtLyah5iW8HBeaxqVti_R2HVOJazPIvdTRWWapw-VnH0KDdR2TF_SUFXoJO8XRIIgFzuXT7SnpbGLHT3UH8BZLQjNL_bAD1Ew 08/04/2025 02:17:06.071 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:17:06.072 7f53e9dc1c18 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 765 response_size_objects = 0 response_size_bytes = 0 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:17:06.416 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBgiku6CZja8TY7m8wCxpFDrWmwJd8jqTOMXqMwogTKiN6m5lSXKbn-hAd1-rkx1taNRFl4g8iQCAs2ZYNaEDbhZ2On7OEX4-UuloDtVLXLaiOc-Umvn2FQNd_UcxvPTKKKR-Ng3Osdg0PtPuKtG6rnS4Dxm3cvnrWIqaa_HFQ5Upjw 08/04/2025 02:17:06.416 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:17:06.418 7f53e630f438 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['NodeStatus'] 08/04/2025 02:17:06.419 7f53e62a1c18 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2394 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:18:07.198 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBheP8zisrSu1a6KMPEtYBUVk4EVZsGvIuw5M-VqiNF7YZEetB0AU8pRFYMIKIoSGcpVlryoR5Ju1BdfQsATPHelmXUbjJgjKXAGEYdVf_abOFYs9EO0h69bkm0mO2yzQ7cy6lvVVMbvx2ZTeQ7YzVXa4MxO1kyalf7LHQwT7OU3PtY 08/04/2025 02:18:07.198 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:18:07.200 7f53e630f438 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['VrouterAgent'] 08/04/2025 02:18:07.201 7f53e78bf390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 1959 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:18:07.870 7f53e630f438 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBhfrEOa4gaehfSqguuOrvFscFEA4ymVNa4V1_l7_aaVB3GdvbFsAV3ko9ohqWfg1ES3hw1uXC9PzprLutbhtYjePtnBBnsmzrwiJVUQRIWoffRBN8HGUDwuZy5d6DAvB1QEwZMyf0LSqeJeD9_47ibQe2i5ZvRejVllem83wCHS0YU 08/04/2025 02:18:07.870 7f53e630f438 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:18:07.872 7f53e630f438 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['NodeStatus'] 08/04/2025 02:18:07.873 7f53e630f0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2884 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:18:16.538 7f53e630f438 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 08/04/2025 02:18:16.902 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: resource list for bgp-peer is None 08/04/2025 02:19:08.488 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBicJUXUtYB426AkM2YiF3Mrf2_P1otPxbojNjJRdSMagZR6zA4FKpbeNH1hafHLrQErzGObN4W7oblRoZYIji7UHajxeza6djoNH9-vkKDKi2rwre9kr87mwWcVhjaj-ygS23VPpthdsC4zJ3a9Iaoeeqrgqz7G6F7_9_YbiQrF7lA 08/04/2025 02:19:08.489 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:19:08.490 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['VrouterAgent'] 08/04/2025 02:19:08.491 7f53e630f0f0 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2342 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:19:09.156 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBicvUw4_bA6QN3dbqS1lnpCsz2dVh7Kk-r9Q3kg5mt1opC-y59tTKuE6ToOLZKGIcKe-LpkbiXcyA4b8YHBlpuECkjDqA0b8Y4FUdZ7adDp9O6wdUBqGN9VyHoYfqGt6NDqAZvp3q_l7XmTMwGJiBn6EDgzxSFzTNAMFbVX8QQuWvk 08/04/2025 02:19:09.156 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:19:09.159 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['NodeStatus'] 08/04/2025 02:19:09.159 7f53e62a1828 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 3448 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:20:10.264 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBja9zf0oB1zkm9EjnOFFFZMfyG4pSBfeIG3S-ydPsOd7tYCakfAu2h9KVnzEj7RbiaXuO6t8Q68z5sTquvFAUuqFrjOp9Gx1j0E5KnTWQ-4u_IIOBpuTWYacxbalLDQtb0EiTnTCI-8T5F0wFQZwwxa8uSzLTjmbOFEsEI7VSg1MSE 08/04/2025 02:20:10.264 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:20:10.266 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['VrouterAgent'] 08/04/2025 02:20:10.266 7f53e836a390 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=VrouterAgent:mode response_time_in_usec = 2342 response_size_objects = 1 response_size_bytes = 104 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:20:10.600 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: uve_type:vrouter user_token:gAAAAABokBja14wfP942uK_gxEMZh8CWZqHdvHQdDsZ8RUR6qEdkc3OMrvkxZZnwtMjl5ZVPGKth8-k3F11GlLciA_7t3x1j-te6zNdZK4jLsPVg8PtGYpiBolYDdWipn2PUKkEQ7QVisANeWhvmeTMO3gQvGryI5obrCfvx0KmWYa2TW20LOFc 08/04/2025 02:20:10.600 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: user resources are None 08/04/2025 02:20:10.602 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: Computed ObjectVRouter:cn-jenkins-deploy-platform-ansible-os-3748-1 as ['NodeStatus'] 08/04/2025 02:20:10.603 7f53e9dc1c18 [contrail-analytics-api] [INFO]: __default__ [SYS_INFO]: AnalyticsApiStats: api_stats = << operation_type = GET remote_ip = 10.0.0.19 object_type = vrouter request_url = http://10.0.0.19:8081/analytics/uves/vrouter/%2A?cfilt=NodeStatus:process_status response_time_in_usec = 2292 response_size_objects = 1 response_size_bytes = 926 resp_code = 200 useragent = python-requests/2.27.1 node = cn-jenkins-deploy-platform-ansible-os-3748-1. >> 08/04/2025 02:20:23.782 7f53e95d3cc0 [contrail-analytics-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:NodeStatusUVE] map