10/02/2025 01:47:53.675 7f6e416327c0 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/02/2025 01:47:53.675 7f6e416327c0 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/02/2025 01:47:53.675 7f6e416327c0 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/02/2025 01:47:53.675 7f6e3ecb6b80 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.676 7f6e3ecb6b80 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.677 7f6e3ecb6b80 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/02/2025 01:47:53.677 7f6e3ecb6b80 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.754 7f6e416327c0 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.56:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 10/02/2025 01:47:53.761 7f6e416327c0 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 10/02/2025 01:47:53.761 7f6e3ef41860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.762 7f6e3ef41860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/02/2025 01:47:53.762 7f6e3ef41860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.762 7f6e3ef41860 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.762 7f6e3ef41860 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/02/2025 01:47:53.762 7f6e3ef41860 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.765 7f6e416327c0 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/02/2025 01:47:53.765 7f6e3ef419a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.765 7f6e3ef419a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/02/2025 01:47:53.765 7f6e3ef419a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.804 7f6e416327c0 [contrail-schema] [WARNING]: RabbitMQ publish connection down 10/02/2025 01:47:53.805 7f6e3f8cd540 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.805 7f6e3f8cd540 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/02/2025 01:47:53.805 7f6e3f8cd540 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.808 7f6e416327c0 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/02/2025 01:47:53.809 7f6e3f8cd540 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.809 7f6e3f8cd540 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/02/2025 01:47:53.809 7f6e3f8cd540 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.831 7f6e416327c0 [contrail-schema] [DEBUG]: Removed remained AMQP queue 10/02/2025 01:47:53.831 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.832 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 10/02/2025 01:47:53.832 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.838 7f6e416327c0 [contrail-schema] [WARNING]: Waiting to be elected as master... 10/02/2025 01:47:53.839 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:53.839 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/02/2025 01:47:53.839 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:57.679 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:47:57.680 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:47:57.681 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:01.683 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:01.684 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:01.684 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:01.685 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:01.685 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:01.685 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:01.685 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:01.685 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:01.686 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:05.687 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:05.688 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:05.688 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:05.688 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:05.689 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:09.691 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:09.692 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:09.692 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:09.692 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:09.693 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:09.694 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:13.695 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:13.697 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:13.698 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:13.699 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:17.699 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:17.700 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:17.701 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:17.701 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:17.702 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:21.703 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:21.704 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:21.705 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:25.707 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:25.709 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:25.710 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:25.711 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:29.711 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:29.712 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:29.712 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:29.712 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:29.713 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:33.714 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:33.715 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:33.716 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:37.719 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:37.720 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:37.721 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:37.722 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:37.722 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:37.722 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:41.723 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:41.724 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:41.724 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:41.724 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:41.724 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:41.725 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:45.728 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:45.729 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:45.730 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:45.731 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:45.731 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:45.731 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:45.731 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:49.731 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:49.732 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:49.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:53.733 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:53.735 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:53.736 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:53.736 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:53.736 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:53.736 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:57.739 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:48:57.740 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:48:57.741 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:01.743 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:01.744 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:01.745 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:01.746 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:01.746 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:01.746 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:01.746 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:05.747 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:05.748 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:05.748 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:05.748 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:05.748 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:05.748 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:05.749 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:09.752 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:09.753 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:09.753 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:09.754 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:09.755 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:09.755 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:09.755 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:09.755 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:09.755 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:13.755 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:13.756 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:13.757 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:13.758 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:13.758 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:17.759 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:17.760 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:17.760 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:17.760 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:17.761 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:21.763 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:21.764 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:21.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:25.765 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:25.767 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:25.768 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:25.768 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:25.768 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:25.768 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:25.768 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:29.771 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:29.772 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:29.772 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:29.772 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:29.773 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:33.776 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:33.777 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:33.778 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:37.779 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:37.781 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:37.782 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:37.782 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:41.783 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:41.784 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:41.785 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:41.785 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:41.785 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:41.785 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:45.787 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:45.788 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:45.789 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:49.792 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:49.793 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:49.793 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:49.794 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:53.796 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:53.797 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:53.797 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:53.797 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:53.797 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:53.797 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:53.798 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:57.802 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:49:57.802 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:49:57.803 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:57.804 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:49:57.804 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:49:57.804 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:01.807 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:50:01.808 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:50:01.808 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:50:01.809 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:05.810 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:50:05.811 7f6e3f8cd9a0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 10/02/2025 01:50:05.811 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:50:05.811 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:05.811 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:50:05.811 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.56:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1759369673676403 collector_name = collector_ip = 10.0.0.56:8086 collector_list = [ 10.0.0.49:8086, 10.0.0.38:8086, 10.0.0.56:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/02/2025 01:50:05.812 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/02/2025 01:50:09.815 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [INFO]: Session Event: TCP Connected 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4210-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.56:5673, 10.0.0.38:5673, 10.0.0.49:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.56:2181, 10.0.0.38:2181, 10.0.0.49:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/02/2025 01:50:09.816 7f6e3f8cd9a0 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 10/02/2025 01:50:09.817 7f6e3f8cd9a0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/02/2025 01:50:09.817 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/02/2025 01:50:09.817 7f6e3f8cd9a0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/02/2025 01:50:09.817 7f6e3f8cdd60 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/02/2025 01:50:09.818 7f6e3f8cdd60 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/02/2025 01:50:19.972 7f6e3f8cd720 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 10/02/2025 01:50:19.973 7f6e3f8cd720 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/02/2025 01:50:19.973 7f6e3ec04180 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/02/2025 01:50:19.973 7f6e3ec04180 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 10/02/2025 01:50:19.974 7f6e3ec04180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/02/2025 01:50:19.974 7f6e3ec04180 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/02/2025 01:50:19.974 7f6e3ec04180 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/02/2025 01:50:19.974 7f6e3ecb6cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/02/2025 01:50:19.976 7f6e3ecb6cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/02/2025 01:50:29.954 7f6e3f8cd720 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 10/02/2025 01:50:29.954 7f6e3f8cd720 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/02/2025 01:50:29.955 7f6e3ecb6d60 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/02/2025 01:50:29.955 7f6e3ecb6d60 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 10/02/2025 01:50:29.955 7f6e3ecb6d60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/02/2025 01:50:29.955 7f6e3ecb6d60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map