03/27/2025 00:47:06.242 7f043e1f7b48 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/27/2025 00:47:06.242 7f043e1f7b48 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/27/2025 00:47:06.242 7f043e1f7b48 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/27/2025 00:47:06.242 7f0433fe6198 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 03/27/2025 00:47:06.243 7f0433fe6198 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/27/2025 00:47:06.243 7f0433fe6198 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:47:06.243 7f0433fe6198 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/27/2025 00:47:06.243 7f0433fe6198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.244 7f0433fe6198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:47:06.244 7f0433fe6198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.244 7f0433fe6198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.244 7f0433fe6198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/27/2025 00:47:06.244 7f0433fe6198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.451 7f043e1f7b48 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.36:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.43:5673//'] 03/27/2025 00:47:06.460 7f043e1f7b48 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 03/27/2025 00:47:06.461 7f0433c0a6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.461 7f0433c0a6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:47:06.461 7f0433c0a6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.461 7f0433c0a6d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.462 7f0433c0a6d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:47:06.462 7f0433c0a6d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.479 7f043e1f7b48 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/27/2025 00:47:06.480 7f0433a97390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.480 7f0433a97390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:47:06.480 7f0433a97390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.612 7f043e1f7b48 [contrail-schema] [WARNING]: RabbitMQ publish connection down 03/27/2025 00:47:06.614 7f0433a92eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.614 7f0433a92eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:47:06.614 7f0433a92eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.618 7f043e1f7b48 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/27/2025 00:47:06.619 7f0433a92eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.619 7f0433a92eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:47:06.619 7f0433a92eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.642 7f043e1f7b48 [contrail-schema] [DEBUG]: Removed remained AMQP queue 03/27/2025 00:47:06.644 7f0433b89048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.644 7f0433b89048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 03/27/2025 00:47:06.644 7f0433b89048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.711 7f043e1f7b48 [contrail-schema] [WARNING]: Waiting to be elected as master... 03/27/2025 00:47:06.712 7f0433b89eb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:06.713 7f0433b89eb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:47:06.713 7f0433b89eb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:10.244 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:10.246 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:10.247 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:10.247 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:10.247 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:10.247 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:10.247 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:10.248 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:10.249 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:14.249 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:14.251 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:14.251 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:14.251 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:14.252 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:14.252 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:14.252 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:14.252 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:14.253 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:18.252 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:18.254 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:18.255 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:22.256 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:22.258 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:22.259 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:22.259 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:22.259 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:22.259 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:22.259 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:26.260 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:26.267 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:26.267 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:26.268 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:26.268 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:26.268 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:26.268 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:26.269 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:30.271 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:30.273 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:30.274 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:30.275 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:34.274 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:34.277 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:34.278 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:34.278 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:34.278 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:34.278 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:34.278 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:34.279 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:38.280 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:38.281 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:38.281 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:38.281 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:38.282 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:38.283 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:38.283 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:38.283 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:38.283 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:42.284 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:42.286 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:42.286 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:42.286 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:42.288 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:42.288 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:42.288 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:42.288 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:42.288 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:42.289 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:42.289 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:42.289 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:42.289 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:42.289 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:46.287 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:46.288 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:46.288 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:46.289 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:46.290 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:46.290 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:46.290 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:50.292 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:50.293 7f0433b89e10 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:50.294 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:50.295 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:50.295 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:50.295 7f0433b89e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:50.295 7f0433b89e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:50.295 7f0433b89e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:54.296 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:54.298 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:54.298 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:54.298 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:54.298 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:54.298 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:54.299 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:54.299 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:54.299 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:54.299 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:54.300 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:54.300 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:54.300 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:54.300 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:58.302 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:47:58.304 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:47:58.304 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:58.305 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:47:58.306 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:47:58.306 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:02.308 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:02.309 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:02.309 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:02.309 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:02.309 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:02.310 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:06.316 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:06.318 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:06.318 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:06.319 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:06.319 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:06.319 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:06.319 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:06.319 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:06.320 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:10.323 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:10.325 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:10.325 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:10.325 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:10.326 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:10.327 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:14.328 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:14.330 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:14.331 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:18.331 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:18.333 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:18.333 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:18.333 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:18.334 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:18.334 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:18.334 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:18.335 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:22.335 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:22.337 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:22.338 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:22.339 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:22.339 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:22.339 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:22.339 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:26.339 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:26.340 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:26.341 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:26.342 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:26.342 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:26.342 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:26.342 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:26.342 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:30.345 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:30.346 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:30.347 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:30.348 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:30.348 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:30.348 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:30.348 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:30.348 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:34.348 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:34.350 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:34.351 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:34.351 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:34.351 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:34.351 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:34.351 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:38.352 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:38.353 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:38.353 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:38.353 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:38.354 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:42.356 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:42.358 7f04339b56d8 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:42.358 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:42.358 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:42.358 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:42.359 7f04339b56d8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:46.363 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:46.365 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:46.366 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:46.367 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:50.370 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:50.372 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:50.372 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:50.372 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:50.373 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:54.376 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:54.377 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:54.377 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:54.377 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:54.377 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:54.377 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:54.378 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:54.379 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:54.379 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:58.380 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:48:58.382 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:48:58.383 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:02.386 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:02.388 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:02.388 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:02.388 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:02.389 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:02.390 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:02.390 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:02.390 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:02.390 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:06.390 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:06.391 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:06.391 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:06.391 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:06.392 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:06.393 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:06.393 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.396 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:10.398 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:10.398 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:10.398 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.399 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:10.400 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.400 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:10.400 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:10.400 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.400 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:14.401 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:14.402 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:14.402 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:14.402 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:14.402 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:14.402 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:14.403 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.402 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:18.404 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:18.404 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:18.404 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:18.404 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:18.404 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.405 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:18.406 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:18.406 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.409 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:22.411 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:22.411 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:22.411 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.412 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:22.413 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:22.413 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.412 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:26.414 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:26.414 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:26.414 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:26.414 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:26.414 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:26.415 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:26.416 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.417 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:30.419 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:30.419 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:30.419 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:30.420 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.421 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:30.421 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:30.421 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.422 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:34.424 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:34.424 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:34.424 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:34.425 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:34.425 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:34.425 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:34.426 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.429 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:38.430 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:38.430 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.431 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:38.432 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.432 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:38.432 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:38.432 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.435 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:42.437 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:42.438 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.440 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:46.441 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:46.442 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:46.443 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.446 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:50.447 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:50.447 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:50.447 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:50.448 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.451 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:54.453 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:54.454 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.455 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:49:58.457 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:49:58.457 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:49:58.457 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:58.457 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:49:58.457 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:49:58.458 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.459 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:02.460 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:02.461 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:02.461 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:02.461 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:02.461 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:02.461 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:02.462 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.465 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:06.467 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:06.468 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.467 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:10.469 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:10.469 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:10.469 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:10.469 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:10.470 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.472 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:14.473 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:14.473 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:14.474 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:14.474 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:14.474 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:14.474 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:14.474 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:14.475 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.477 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:18.479 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:18.479 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:18.479 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:18.479 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:18.480 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.481 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:18.481 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:18.481 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.483 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:22.485 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:22.485 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:22.485 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:22.486 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.489 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:26.490 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:26.490 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:26.490 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:26.490 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:26.491 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:26.491 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:26.491 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:26.491 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.492 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:26.492 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.492 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:26.492 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:26.492 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.493 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:30.494 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:30.495 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.496 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:30.496 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.496 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:30.496 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:30.496 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.499 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:34.501 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:34.501 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:34.501 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:34.501 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.502 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:34.503 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:34.503 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.504 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:38.506 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:38.507 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.511 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:42.513 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:42.514 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.516 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:46.518 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:46.519 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.519 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:50.521 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:50.522 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.525 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:54.527 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.36:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:54.528 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.528 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:50:58.530 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:50:58.530 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:50:58.530 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:58.530 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:50:58.531 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.532 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:02.533 7f043f0b2198 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 03/27/2025 00:51:02.533 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:02.533 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1743036426243448 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.27:8086, 10.0.0.36:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/27/2025 00:51:02.534 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:06.536 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:06.537 7f043f0b2198 [contrail-schema] [INFO]: Session Event: TCP Connected 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-2. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 03/27/2025 00:51:06.538 7f043f0b2198 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/27/2025 00:51:06.539 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:06.539 7f043f0b2198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:06.539 7f0433bb0d68 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/27/2025 00:51:06.540 7f0433bb0d68 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/27/2025 00:51:20.329 7f0433bb02e8 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 03/27/2025 00:51:20.330 7f0433bb02e8 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/27/2025 00:51:20.330 7f0433bb0d68 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/27/2025 00:51:20.331 7f0433bb0d68 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 03/27/2025 00:51:20.331 7f0433bb0d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/27/2025 00:51:20.331 7f0433bb0d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:51:20.332 7f0433bb0d68 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/27/2025 00:51:20.332 7f043ca3ac18 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/27/2025 00:51:20.334 7f043ca3ac18 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/27/2025 00:51:31.477 7f0433bb02e8 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 03/27/2025 00:51:31.477 7f0433bb02e8 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/27/2025 00:51:31.478 7f043ca3ac18 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 03/27/2025 00:51:31.478 7f043ca3ac18 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 03/27/2025 00:51:31.478 7f043ca3ac18 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/27/2025 00:51:31.478 7f043ca3ac18 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map