07/03/2025 00:46:11.540 7fee5915d308 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/03/2025 00:46:11.540 7fee5915d308 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/03/2025 00:46:11.540 7fee5915d308 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/03/2025 00:46:11.541 7fee530130f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 07/03/2025 00:46:11.541 7fee530130f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.542 7fee530130f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/03/2025 00:46:11.543 7fee530130f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.719 7fee5915d308 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 07/03/2025 00:46:11.736 7fee5915d308 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 07/03/2025 00:46:11.737 7fee52c34630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.737 7fee52c34630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:11.737 7fee52c34630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.738 7fee52c34630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:11.738 7fee52c34630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:11.738 7fee52c34630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.542 7fee52c344e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:15.544 7fee52c344e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.545 7fee52c344e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:15.545 7fee52c344e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.545 7fee52c344e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:15.545 7fee52c344e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:15.545 7fee52c344e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.545 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:19.546 7fee52b62390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:19.547 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.548 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:19.548 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.548 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:19.548 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:19.548 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.548 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:23.550 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:23.551 7fee52b62390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.770 7fee5915d308 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/03/2025 00:46:23.772 7fee52b67f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.772 7fee52b67f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.772 7fee52b67f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.791 7fee5915d308 [contrail-schema] [WARNING]: RabbitMQ publish connection down 07/03/2025 00:46:23.792 7fee52abde10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.792 7fee52abde10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/03/2025 00:46:23.793 7fee52abde10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.798 7fee5915d308 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/03/2025 00:46:23.799 7fee52abd240 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.799 7fee52abd240 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.799 7fee52abd240 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.815 7fee5915d308 [contrail-schema] [DEBUG]: Removed remained AMQP queue 07/03/2025 00:46:23.816 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.816 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/03/2025 00:46:23.817 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.825 7fee5915d308 [contrail-schema] [WARNING]: Waiting to be elected as master... 07/03/2025 00:46:23.825 7fee52b62978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:23.826 7fee52b62978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:23.826 7fee52b62978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.552 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:27.557 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:27.557 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:27.557 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:27.558 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.559 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:27.559 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:27.559 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.561 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:31.563 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:31.564 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.567 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:35.568 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:35.569 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:35.569 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:35.569 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:35.569 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:35.569 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:35.570 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.572 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:39.574 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:39.575 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.575 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:43.576 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:43.577 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.580 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:47.582 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:47.583 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.583 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:51.584 7fee52b628d0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:51.584 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:51.584 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.585 7fee52b628d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:51.586 7fee52b628d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:51.586 7fee52b628d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.588 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:55.590 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:55.591 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:55.592 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.592 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:46:59.594 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:46:59.595 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.595 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:03.597 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:03.598 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.600 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:07.601 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:07.602 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:07.603 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.604 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:11.606 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:11.606 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:11.607 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:11.607 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:11.607 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:11.607 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:11.607 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:11.608 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.608 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:15.610 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:15.610 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:15.610 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:15.610 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.611 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:15.612 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:15.612 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.612 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:19.613 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:19.614 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:19.614 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:19.614 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:19.614 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:19.614 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:19.615 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:19.615 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.615 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:19.615 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.615 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:19.616 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:19.616 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.616 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:23.617 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.618 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:23.619 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.619 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:23.619 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:23.619 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.622 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:27.623 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:27.624 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.625 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:27.625 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.625 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:27.625 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:27.625 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.625 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:31.626 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:31.626 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:31.626 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:31.626 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:31.626 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:31.627 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:31.628 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.631 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:35.633 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:35.634 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.634 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:39.636 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:39.637 7fee52b9e390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.637 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:43.639 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.640 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:43.640 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.640 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:43.640 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:43.640 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.643 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:47.645 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:47.646 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.648 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:51.650 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.651 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:51.651 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.651 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:51.651 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:51.651 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.654 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:55.655 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:55.655 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:55.655 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:55.656 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:55.656 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:55.656 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:55.656 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:55.657 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.657 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:47:59.659 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:47:59.660 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.661 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:03.663 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.664 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:03.664 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.664 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:03.664 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:03.664 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.664 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:07.665 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:07.665 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:07.665 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:07.665 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:07.666 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.668 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:11.669 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:11.669 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:11.669 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:11.670 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:11.670 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:11.670 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:11.670 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:11.670 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.671 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:11.671 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.671 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:11.671 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:11.671 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.671 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:15.673 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:15.674 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.677 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:19.679 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:19.680 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.680 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:23.682 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:23.682 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:23.682 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:23.682 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.683 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:23.684 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:23.684 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.685 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:27.686 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:27.687 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:27.687 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:27.687 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:27.687 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:27.687 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.27:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:27.688 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.688 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:31.690 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3.:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1751503571541946 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.27:8086, 10.0.0.23:8086, 10.0.0.41:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/03/2025 00:48:31.691 7fee529ed978 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/03/2025 00:48:35.691 7fee52b9e4e0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/03/2025 00:48:35.692 7fee52b9e4e0 [contrail-schema] [INFO]: Session Event: TCP Connected 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3591-3. process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/03/2025 00:48:35.694 7fee52b9e4e0 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 07/03/2025 00:48:35.695 7fee52b9e4e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/03/2025 00:48:35.695 7fee52b9e4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:35.695 7fee52b9e4e0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/03/2025 00:48:35.695 7fee52b9e780 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:35.697 7fee52b9e780 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:45.941 7fee52b9ec18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001016 07/03/2025 00:48:45.942 7fee52b9ec18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:45.942 7fee56b84eb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/03/2025 00:48:45.943 7fee56b84eb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 07/03/2025 00:48:45.944 7fee56b84eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:45.944 7fee56b84eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/03/2025 00:48:45.944 7fee56b84eb8 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/03/2025 00:48:45.944 7fee53007cc0 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/03/2025 00:48:45.945 7fee53007cc0 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/03/2025 00:48:55.927 7fee52b9ec18 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001296 07/03/2025 00:48:55.927 7fee52b9ec18 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/03/2025 00:48:55.928 7fee56b84eb8 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/03/2025 00:48:55.928 7fee56b84eb8 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 2 07/03/2025 00:48:55.928 7fee56b84eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/03/2025 00:48:55.928 7fee56b84eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map