03/20/2025 00:45:47.618 7fcac792f308 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 00:45:47.619 7fcac792f308 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 00:45:47.619 7fcac792f308 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 00:45:47.619 7fcac16f1198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 00:45:47.619 7fcac16f1198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 00:45:47.620 7fcac16f1198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.773 7fcac792f308 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 00:45:47.782 7fcac792f308 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:45:47.783 7fcac13146d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.798 7fcac792f308 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/20/2025 00:45:47.798 7fcac11a2390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.798 7fcac11a2390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:47.799 7fcac11a2390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.871 7fcac792f308 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/20/2025 00:45:47.872 7fcac119deb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.872 7fcac119deb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 00:45:47.872 7fcac119deb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.875 7fcac792f308 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/20/2025 00:45:47.876 7fcac119deb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.876 7fcac119deb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:47.876 7fcac119deb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.958 7fcac792f308 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/20/2025 00:45:47.959 7fcac1253048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.959 7fcac1253048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 00:45:47.960 7fcac1253048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.976 7fcac792f308 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/20/2025 00:45:47.976 7fcac1253eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:47.976 7fcac1253eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 00:45:47.976 7fcac1253eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:51.622 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:45:51.624 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:45:51.624 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:45:51.624 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:51.624 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:45:51.624 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:45:51.625 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:55.626 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:45:55.627 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:45:55.628 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:59.630 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:45:59.630 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:45:59.631 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:03.634 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:03.635 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:03.635 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:03.635 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:03.635 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:03.636 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:07.638 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:07.640 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:07.640 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:07.641 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:07.642 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:11.645 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:11.646 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:11.647 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:11.647 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:11.647 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:11.647 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:15.648 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:15.650 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:15.651 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:15.651 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:15.651 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:15.651 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:15.651 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:15.652 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.654 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:19.655 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:19.655 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:19.655 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:19.655 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:19.656 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.657 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:19.657 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:19.657 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:23.659 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:23.659 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:23.660 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:23.661 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:23.661 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:23.661 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:27.661 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:27.663 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:27.664 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:27.664 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:27.664 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:27.664 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:31.667 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:31.670 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:31.671 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:31.671 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:31.671 7fcac1253e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:31.671 7fcac1253e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:31.671 7fcac1253e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:35.674 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:35.674 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:35.675 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:35.676 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:35.676 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:39.678 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:39.679 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:39.679 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:39.679 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:39.680 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:39.681 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:39.681 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:39.681 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:39.681 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:43.683 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:43.684 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:43.684 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:43.684 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:43.685 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:43.686 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:47.686 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:47.687 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:47.688 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:47.688 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:47.688 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:51.690 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:51.691 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:51.692 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:55.693 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:55.695 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:55.696 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:59.699 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:46:59.700 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:46:59.700 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:46:59.700 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:59.701 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:46:59.702 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:46:59.702 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:03.706 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:03.708 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:03.710 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:03.710 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:03.711 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:07.710 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:07.712 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:07.712 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:07.712 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:07.712 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:07.712 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:07.713 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:11.715 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:11.716 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:11.717 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:15.720 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:15.721 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:15.721 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:15.722 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:15.723 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:15.723 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:15.723 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:15.723 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:15.723 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:19.726 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:19.727 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:19.728 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:23.730 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:23.731 7fcac10bf6d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:23.732 7fcac10bf6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:27.735 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:27.736 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:27.736 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:27.737 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:31.741 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:31.742 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:31.743 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:31.744 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:35.746 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:35.746 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:35.747 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:35.748 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.750 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:39.751 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:39.752 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:43.754 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:43.755 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:43.756 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:47.758 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:47.759 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:47.760 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:51.762 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:51.763 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:51.763 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:51.763 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:51.764 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:55.766 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:55.767 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:55.768 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:59.767 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:47:59.768 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:47:59.768 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:47:59.768 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:47:59.769 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:03.773 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:03.774 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:03.774 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:03.774 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:03.774 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:03.774 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:03.775 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:07.778 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:07.779 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:07.780 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:11.782 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:11.783 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:11.784 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:15.786 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:15.788 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:15.788 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:15.788 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:15.789 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:19.790 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:19.791 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:19.792 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:23.795 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:23.795 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:23.796 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:23.797 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:23.797 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:27.799 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:27.800 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:27.800 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:27.800 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:27.800 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:27.800 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:27.801 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:31.804 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:31.806 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:31.807 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:35.810 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:35.811 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:35.812 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:39.813 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:39.814 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:39.815 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:43.818 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:43.819 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:43.820 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:43.820 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:43.820 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:43.820 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:43.820 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:43.821 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:43.821 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:47.822 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:47.823 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:47.824 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:47.824 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:47.824 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:51.824 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:51.830 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:51.831 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:55.834 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:55.835 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:55.836 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:59.838 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:48:59.839 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:48:59.840 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:03.842 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:03.843 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:03.844 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:07.846 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:07.847 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:07.847 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:07.847 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:07.847 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:07.848 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:11.850 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:11.851 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:11.852 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:15.855 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:15.856 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:15.856 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:15.857 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:15.858 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:19.858 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:19.859 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:19.859 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:19.860 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:19.861 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:19.861 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:19.861 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:19.861 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:19.861 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:23.862 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:23.863 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 00:49:23.864 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 00:49:27.867 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 00:49:27.868 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 00:49:27.869 7fcac87bb198 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 00:49:27.869 7fcac87bb198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 00:49:27.869 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:27.869 7fcac87bb198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 00:49:27.869 7fcac1253eb8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:27.870 7fcac1253eb8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:38.837 7fcac11a2e10 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 03/20/2025 00:49:38.837 7fcac11a2e10 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:38.838 7fcac256cf60 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 00:49:38.838 7fcac256cf60 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 00:49:38.838 7fcac256cf60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:49:38.838 7fcac256cf60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 00:49:38.838 7fcac256cf60 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 00:49:38.839 7fcac10c68d0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 00:49:38.840 7fcac10c68d0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 00:49:50.717 7fcac11a2e10 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001297 03/20/2025 00:49:50.718 7fcac11a2e10 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 00:49:50.718 7fcac2575a20 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 00:49:50.718 7fcac2575a20 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 03/20/2025 00:49:50.718 7fcac2575a20 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 00:49:50.718 7fcac2575a20 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:52:46.886 7fcac11a2e10 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:52:46.886 7fcac10c68d0 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[Established] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[Established] -> State[Connect] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Established to Connect on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, ] description = Collector:Collector[Established to Connect on EvTcpClose], Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying] connection down >>, ] >> 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:52:46.891 7fcac10c68d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.892 7fcac10c68d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying] connection down >>, ] >> 03/20/2025 01:52:46.892 7fcac10c68d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.892 7fcac10c68d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:46.892 7fcac10c68d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 1 pid = 1 start_time = 1742431547619964 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.12:8086, 10.0.0.47:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 03/20/2025 01:52:46.892 7fcac10c68d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:52:50.891 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:52:50.892 7fcac10c6d68 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 01:52:50.892 7fcac10c6d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:52:50.892 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = Connection to zookeeper lost. Retrying >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Zookeeper:Zookeeper[Connection to zookeeper lost. Retrying] connection down >>, ] >> 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:52:50.893 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:50.894 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:52:50.894 7fcac1279ac8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.894 7fcac1279ac8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:52:50.912 7fcac1279d68 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:52:50.913 7fcac1279d68 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:52:50.913 7fcac10c6d68 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:52:50.913 7fcac10c6d68 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:52:50.913 7fcac10c6d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:52:50.913 7fcac10c6d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:52:50.913 7fcac10c6d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:52:50.914 7fcac1279ac8 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:52:50.915 7fcac1279ac8 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:08.462 7f70bb32bb48 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 01:53:08.463 7f70bb32bb48 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 01:53:08.464 7f70bb32bb48 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 01:53:08.464 7f70b517a198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 01:53:08.465 7f70b517a198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:53:08.465 7f70b517a198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:53:08.466 7f70b517a198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 01:53:08.466 7f70b517a198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.466 7f70b517a198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:53:08.467 7f70b517a198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.467 7f70b517a198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.467 7f70b517a198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435588465681 collector_name = collector_ip = collector_list = [ 10.0.0.42:8086, 10.0.0.12:8086, 10.0.0.47:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 01:53:08.468 7f70b517a198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.615 7f70bb32bb48 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 01:53:08.623 7f70bb32bb48 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:53:08.624 7f70b4d606d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.634 7f70bb32bb48 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/20/2025 01:53:08.634 7f70b4c2b390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.634 7f70b4c2b390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:53:08.634 7f70b4c2b390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.648 7f70bb32bb48 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/20/2025 01:53:08.649 7f70b4c26eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.649 7f70b4c26eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:53:08.649 7f70b4c26eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.652 7f70bb32bb48 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/20/2025 01:53:08.652 7f70b4c26eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.653 7f70b4c26eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:53:08.653 7f70b4c26eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.659 7f70bb32bb48 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/20/2025 01:53:08.661 7f70b4d1d048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.661 7f70b4d1d048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 01:53:08.661 7f70b4d1d048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.666 7f70bb32bb48 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/20/2025 01:53:08.667 7f70b4d1deb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:08.667 7f70b4d1deb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:53:08.667 7f70b4d1deb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:53:12.466 7f70b4d1de10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:53:12.467 7f70b4d1de10 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:53:12.468 7f70b4d1de10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:53:12.469 7f70b4d1de10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:53:12.469 7f70b4d31cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:12.470 7f70b4d31cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:53:12.476 7f70b5179eb8 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:53:12.476 7f70b5179eb8 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:53:12.477 7f70b4c26ac8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:53:12.477 7f70b4c26ac8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:53:12.477 7f70b4c26ac8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:53:12.477 7f70b4c26ac8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:53:12.477 7f70b4c26ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:53:12.478 7f70b9bca390 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:53:12.479 7f70b9bca390 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:03.589 7f698fc217c8 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 01:57:03.589 7f698fc217c8 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 01:57:03.589 7f698fc217c8 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 01:57:03.589 7f698df50198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 01:57:03.602 7f698df50198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 01:57:03.603 7f698df50198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.732 7f698fc217c8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 01:57:03.747 7f698fc217c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/20/2025 01:57:03.747 7f698d5f50f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.747 7f698d5f50f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:03.748 7f698d5f50f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.748 7f698d5f50f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.748 7f698d5f50f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:03.748 7f698d5f50f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.762 7f698fc217c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/20/2025 01:57:03.763 7f698d5f50f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.763 7f698d5f50f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:03.763 7f698d5f50f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.827 7f698fc217c8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/20/2025 01:57:03.827 7f698d5f5c18 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.828 7f698d5f5c18 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 01:57:03.828 7f698d5f5c18 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.831 7f698fc217c8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/20/2025 01:57:03.831 7f69963d5978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.831 7f69963d5978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:03.831 7f69963d5978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.917 7f698fc217c8 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/20/2025 01:57:03.918 7f698c3ed240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.918 7f698c3ed240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 01:57:03.918 7f698c3ed240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.927 7f698fc217c8 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/20/2025 01:57:03.928 7f698d125780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:03.928 7f698d125780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 01:57:03.928 7f698d125780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.607 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:07.608 7f698d1256d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:07.608 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:07.609 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:07.610 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:11.610 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:11.611 7f698d1256d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:11.611 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:11.611 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:11.612 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:15.614 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:15.614 7f698d1256d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:15.615 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:15.616 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:15.616 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:19.618 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:19.619 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:19.620 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:23.623 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:23.624 7f698d1256d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:23.625 7f698d1256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:23.626 7f698d1256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:27.628 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:27.628 7f698d139ac8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:27.629 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:27.630 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:27.630 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:31.630 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:31.631 7f698d139ac8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:31.631 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:31.631 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:31.631 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:31.632 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:35.634 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:35.637 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:35.638 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:39.641 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:39.646 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.42:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:39.647 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:43.647 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:43.648 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.47:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:43.649 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:47.650 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:47.654 7f698d139ac8 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 01:57:47.655 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:47.655 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:47.655 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:47.655 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:47.655 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:57:47.656 7f698d139ac8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:57:47.656 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:57:47.656 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:47.656 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:47.657 7f698d144588 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:47.662 7f698d144588 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:48.739 7f698d144438 [contrail-schema] [ERROR]: Session Event: TCP Connection Closed 03/20/2025 01:57:48.740 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/20/2025 01:57:48.740 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/20/2025 01:57:48.740 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:48.740 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.12:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down >>, ] >> 03/20/2025 01:57:48.740 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:48.741 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:48.741 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 1 pid = 1 start_time = 1742435823603135 collector_name = collector_ip = 10.0.0.12:8086 collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/20/2025 01:57:48.741 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 01:57:52.746 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 01:57:52.749 7f698d139ac8 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 01:57:52.749 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 01:57:52.749 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:52.749 7f698d139ac8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.42:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 01:57:52.758 7f698d139ac8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 01:57:52.758 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 01:57:52.759 7f698d139ac8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 01:57:52.759 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 01:57:52.759 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:52.759 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 01:57:52.759 7f698d144cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:52.760 7f698d144cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:52.776 7f698d144b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 01:57:52.776 7f698d144b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:52.777 7f698d139ac8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 01:57:52.777 7f698d139ac8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 01:57:52.777 7f698d139ac8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:52.777 7f698d139ac8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 01:57:52.777 7f698d139ac8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 01:57:52.777 7f698d144e10 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 01:57:52.791 7f698d144e10 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 01:57:57.951 7f698d144b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 03/20/2025 01:57:57.951 7f698d144b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 01:57:57.952 7f698d13e828 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/20/2025 01:57:57.952 7f698d13e828 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 03/20/2025 01:57:57.952 7f698d13e828 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 01:57:57.952 7f698d13e828 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:02:24.157 7f21554d8b88 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 02:02:24.157 7f21554d8b88 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 02:02:24.157 7f21554d8b88 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 02:02:24.157 7f21538d8198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 02:02:24.158 7f21538d8198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:02:24.158 7f21538d8198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742436144158669 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.12:8086, 10.0.0.42:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 02:02:24.159 7f21538d8198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.240 7f21554d8b88 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 02:02:24.248 7f21554d8b88 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:02:24.249 7f2152f430f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.254 7f21554d8b88 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/20/2025 02:02:24.255 7f2152f43240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.257 7f2152f43240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:02:24.257 7f2152f43240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.283 7f21554d8b88 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/20/2025 02:02:24.284 7f2152ca1588 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.284 7f2152ca1588 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:02:24.284 7f2152ca1588 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.287 7f21554d8b88 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/20/2025 02:02:24.287 7f2152ca1048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.288 7f2152ca1048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:02:24.288 7f2152ca1048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.314 7f21554d8b88 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/20/2025 02:02:24.315 7f2152cbb240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.315 7f2152cbb240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 02:02:24.315 7f2152cbb240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.323 7f21554d8b88 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/20/2025 02:02:24.323 7f2152d34780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:24.323 7f2152d34780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:02:24.323 7f2152d34780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:02:28.162 7f2152d346d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 02:02:28.163 7f2152d346d8 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 02:02:28.163 7f2152d346d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 02:02:28.163 7f2152d346d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:02:28.164 7f2152d346d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:02:28.164 7f2152d3eb70 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:02:28.165 7f2152d3eb70 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:02:28.168 7f2152d3ea20 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 02:02:28.169 7f2152d3ea20 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 02:02:28.173 7f21538f8588 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 02:02:28.173 7f21538f8588 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 02:02:28.173 7f21538f8588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:02:28.173 7f21538f8588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:02:28.174 7f21538f8588 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 02:02:28.174 7f2152d3ec18 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:02:28.175 7f2152d3ec18 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:04:03.829 7fe42094e408 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/20/2025 02:04:03.830 7fe42094e408 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/20/2025 02:04:03.830 7fe42094e408 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/20/2025 02:04:03.830 7fe41ed67198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/20/2025 02:04:03.831 7fe41ed67198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:04:03.831 7fe41ed67198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:04:03.831 7fe41ed67198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/20/2025 02:04:03.831 7fe41ed67198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.831 7fe41ed67198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:04:03.832 7fe41ed67198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.832 7fe41ed67198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.832 7fe41ed67198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1742436243831412 collector_name = collector_ip = collector_list = [ 10.0.0.47:8086, 10.0.0.42:8086, 10.0.0.12:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/20/2025 02:04:03.832 7fe41ed67198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.898 7fe42094e408 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.42:5673//', 'pyamqp://guest:guest@10.0.0.12:5673//', 'pyamqp://guest:guest@10.0.0.47:5673//'] 03/20/2025 02:04:03.906 7fe42094e408 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:04:03.907 7fe41e3cf0f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.911 7fe42094e408 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/20/2025 02:04:03.911 7fe41e3cf240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.912 7fe41e3cf240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:04:03.912 7fe41e3cf240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.923 7fe42094e408 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/20/2025 02:04:03.924 7fe41de91588 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.924 7fe41de91588 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/20/2025 02:04:03.924 7fe41de91588 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.929 7fe42094e408 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/20/2025 02:04:03.930 7fe427156978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.930 7fe427156978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:04:03.931 7fe427156978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.936 7fe42094e408 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/20/2025 02:04:03.937 7fe41deaa240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.937 7fe41deaa240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/20/2025 02:04:03.937 7fe41deaa240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.946 7fe42094e408 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/20/2025 02:04:03.946 7fe41df25780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:03.946 7fe41df25780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/20/2025 02:04:03.946 7fe41df25780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/20/2025 02:04:07.834 7fe41df256d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/20/2025 02:04:07.835 7fe41df256d8 [contrail-schema] [INFO]: Session Event: TCP Connected 03/20/2025 02:04:07.835 7fe41df256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/20/2025 02:04:07.835 7fe41df256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:04:07.835 7fe41df256d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2923-1. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.47:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.42:5673, 10.0.0.12:5673, 10.0.0.47:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.42:2181, 10.0.0.12:2181, 10.0.0.47:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/20/2025 02:04:07.835 7fe41df256d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/20/2025 02:04:07.836 7fe41df256d8 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/20/2025 02:04:07.836 7fe41df256d8 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/20/2025 02:04:07.836 7fe41df256d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/20/2025 02:04:07.836 7fe41df256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:04:07.836 7fe41df256d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/20/2025 02:04:07.836 7fe41df2eb70 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:04:07.838 7fe41df2eb70 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/20/2025 02:04:07.840 7fe41df2ea20 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001017 03/20/2025 02:04:07.841 7fe41df2ea20 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/20/2025 02:04:07.841 7fe41ed8b588 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/20/2025 02:04:07.841 7fe41ed8b588 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/20/2025 02:04:07.841 7fe41ed8b588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/20/2025 02:04:07.841 7fe41ed8b588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/20/2025 02:04:07.841 7fe41ed8b588 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/20/2025 02:04:07.842 7fe41df2ec18 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/20/2025 02:04:07.842 7fe41df2ec18 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]