06/05/2025 00:42:45.033 7ff712094088 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/05/2025 00:42:45.034 7ff712094088 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/05/2025 00:42:45.034 7ff712094088 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/05/2025 00:42:45.034 7ff70c1590f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 06/05/2025 00:42:45.034 7ff70c1590f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.035 7ff70c1590f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.036 7ff70c1590f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 06/05/2025 00:42:45.036 7ff70c1590f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.259 7ff712094088 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.131:5673//'] 06/05/2025 00:42:45.268 7ff712094088 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 06/05/2025 00:42:45.269 7ff707b37630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.269 7ff707b37630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/05/2025 00:42:45.269 7ff707b37630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.269 7ff707b37630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.269 7ff707b37630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/05/2025 00:42:45.270 7ff707b37630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.279 7ff712094088 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 06/05/2025 00:42:45.279 7ff7079c7f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.279 7ff7079c7f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/05/2025 00:42:45.279 7ff7079c7f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.312 7ff712094088 [contrail-schema] [WARNING]: RabbitMQ publish connection down 06/05/2025 00:42:45.313 7ff7079c7eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.314 7ff7079c7eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/05/2025 00:42:45.314 7ff7079c7eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.317 7ff712094088 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/05/2025 00:42:45.318 7ff7185d6978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.318 7ff7185d6978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/05/2025 00:42:45.318 7ff7185d6978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.340 7ff712094088 [contrail-schema] [DEBUG]: Removed remained AMQP queue 06/05/2025 00:42:45.341 7ff707b5c8d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.342 7ff707b5c8d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 06/05/2025 00:42:45.342 7ff707b5c8d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.349 7ff712094088 [contrail-schema] [WARNING]: Waiting to be elected as master... 06/05/2025 00:42:45.350 7ff707a79e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:45.350 7ff707a79e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/05/2025 00:42:45.350 7ff707a79e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:49.037 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:49.039 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:42:49.040 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:42:49.040 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:49.040 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:42:49.040 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:49.041 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:49.041 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:42:49.041 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:53.041 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:53.043 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:42:53.044 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:57.046 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:42:57.048 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:42:57.048 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:42:57.048 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:57.049 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:42:57.050 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:42:57.050 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:01.050 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:01.051 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:01.051 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:01.051 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:01.051 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:01.052 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:05.053 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:05.054 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:05.055 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:05.056 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:05.056 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:05.056 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:05.056 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:05.056 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:09.059 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:09.060 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:09.061 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:09.061 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:09.061 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:09.061 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:09.061 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:09.063 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:09.064 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:13.061 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:13.063 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:13.064 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:17.065 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:17.071 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:17.073 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:17.074 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:17.074 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:17.075 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:17.075 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:17.075 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:17.075 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:21.076 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:21.078 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:21.079 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:21.079 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:21.079 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:21.079 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:21.079 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:21.080 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:21.080 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:25.079 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:25.080 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:25.080 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:25.081 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:25.082 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:25.082 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:25.082 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:25.082 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:29.085 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:29.087 7ff707a79d68 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:29.087 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:29.087 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:29.088 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:29.089 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:29.089 7ff707a79d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:29.089 7ff707a79d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:29.089 7ff707a79d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:33.091 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:33.092 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:33.093 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:33.093 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:33.093 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:33.093 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:33.093 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:33.094 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:37.093 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:37.094 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:37.094 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:37.095 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:37.096 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:37.096 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:41.097 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:41.099 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:41.100 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:45.101 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:45.103 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:45.104 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:49.105 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:49.106 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:49.106 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:49.107 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:49.108 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:49.108 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:49.108 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:49.108 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:49.108 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:53.109 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:53.111 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:53.112 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:57.113 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:43:57.115 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:43:57.116 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:43:57.116 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:57.116 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:43:57.116 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:57.118 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:43:57.118 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:43:57.118 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:01.119 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:01.120 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:01.121 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:01.122 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:05.123 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:05.124 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:05.124 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:05.124 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:05.125 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:05.126 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:05.126 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:09.125 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:09.127 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:09.128 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:13.129 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:13.130 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:13.131 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:13.132 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:13.132 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:13.132 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:13.132 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:13.132 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:17.131 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:17.133 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:17.134 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:21.137 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:21.139 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:21.140 7ff7078e7630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:25.142 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:25.143 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:25.144 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:25.145 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:25.145 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:25.145 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:25.145 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:29.148 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:29.149 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:29.150 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:29.151 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:29.151 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:29.151 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:29.151 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:29.151 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:33.153 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:33.158 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:33.159 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:37.160 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:37.161 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:37.162 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:37.163 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:37.163 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:37.163 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:37.163 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:41.165 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:41.167 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:41.168 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:45.169 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:45.171 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:45.172 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:49.175 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:49.176 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.131:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1749084165035252 collector_name = collector_ip = 10.0.0.131:8086 collector_list = [ 10.0.0.131:8086, 10.0.0.27:8086, 10.0.0.249:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/05/2025 00:44:49.177 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/05/2025 00:44:53.177 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/05/2025 00:44:53.179 7ff7078ebf60 [contrail-schema] [INFO]: Session Event: TCP Connected 06/05/2025 00:44:53.179 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/05/2025 00:44:53.179 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:53.180 7ff7078ebf60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3401-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.27:5673, 10.0.0.131:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.27:2181, 10.0.0.131:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/05/2025 00:44:53.180 7ff7078ebf60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/05/2025 00:44:53.180 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/05/2025 00:44:53.181 7ff7078ebf60 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 06/05/2025 00:44:53.182 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/05/2025 00:44:53.182 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/05/2025 00:44:53.182 7ff7078ebf60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/05/2025 00:44:53.182 7ff707a966d8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/05/2025 00:44:53.183 7ff707a966d8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/05/2025 00:45:00.509 7ff707a8beb8 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 06/05/2025 00:45:00.510 7ff707a8beb8 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/05/2025 00:45:00.511 7ff70faf2eb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/05/2025 00:45:00.511 7ff70faf2eb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 06/05/2025 00:45:00.511 7ff70faf2eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/05/2025 00:45:00.511 7ff70faf2eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/05/2025 00:45:00.511 7ff70faf2eb8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/05/2025 00:45:00.511 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/05/2025 00:45:00.512 7ff7078ebf60 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/05/2025 00:45:11.116 7ff707a8beb8 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 06/05/2025 00:45:11.116 7ff707a8beb8 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/05/2025 00:45:11.117 7ff70faf2eb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/05/2025 00:45:11.117 7ff70faf2eb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 06/05/2025 00:45:11.117 7ff70faf2eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/05/2025 00:45:11.117 7ff70faf2eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map