10/20/2025 05:04:53.306 7fb9cf7e40c8 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/20/2025 05:04:53.306 7fb9cf7e40c8 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/20/2025 05:04:53.306 7fb9cf7e40c8 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/20/2025 05:04:53.306 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.254:2181,10.0.0.48:2181,10.0.0.49:2181 10/20/2025 05:04:53.307 7fb9cf7e40c8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:04:53.307 7fb9c6614eb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 10/20/2025 05:04:53.307 7fb9c6614eb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 10/20/2025 05:04:53.308 7fb9c65aa828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 10/20/2025 05:04:53.309 7fb9c65aa828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/20/2025 05:04:53.309 7fb9c65aa828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.310 7fb9c65aa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 10/20/2025 05:04:53.311 7fb9c65aa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.323 7fb9c65ce198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:53.323 7fb9c65ce198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/20/2025 05:04:53.323 7fb9c65ce198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:57.312 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:04:57.313 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:04:57.314 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:01.316 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:01.318 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:01.319 7fb9c656db70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.296 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.254:9041', '10.0.0.48:9041', '10.0.0.49:9041'] 10/20/2025 05:05:05.296 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 10/20/2025 05:05:05.297 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 10/20/2025 05:05:05.297 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 10/20/2025 05:05:05.297 7fb9cda5a828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.297 7fb9cda5a828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:05:05.297 7fb9cda5a828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.298 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 10/20/2025 05:05:05.320 7fb9c6566d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.322 7fb9c6566d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.323 7fb9c6566d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:05.323 7fb9c6566d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.342 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 10/20/2025 05:05:05.344 7fb9c6594588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.344 7fb9c6594588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:05:05.344 7fb9c6594588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.353 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 10/20/2025 05:05:05.353 7fb9c6594390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.353 7fb9c6594390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:05:05.353 7fb9c6594390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.369 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 10/20/2025 05:05:05.468 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 10/20/2025 05:05:05.469 7fb9c64b86d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.469 7fb9c64b86d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/20/2025 05:05:05.469 7fb9c64b86d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.606 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 10/20/2025 05:05:05.615 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/20/2025 05:05:05.615 7fb9c5c0a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.616 7fb9c5c0a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:05.616 7fb9c5c0a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.616 7fb9c5c0a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:05.616 7fb9c5c0a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:05.616 7fb9c5c0a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:09.322 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:09.323 7fb9c5a8c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:09.323 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:09.323 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:09.324 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:09.325 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:09.325 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:13.325 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:13.326 7fb9c5a8c978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:13.327 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:13.328 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:13.328 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:13.328 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:13.328 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:13.328 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:17.327 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:17.329 7fb9c5a8c978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:17.329 7fb9c5a8c978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:17.329 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:17.330 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:17.331 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:17.331 7fb9c5a8c978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:17.331 7fb9c5a8c978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:17.331 7fb9c5a8c978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:21.330 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:21.331 7fb9c5b018d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:21.331 7fb9c5b018d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:21.332 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:21.332 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:21.332 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:21.332 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:21.333 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:25.332 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:25.340 7fb9c5b018d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:25.340 7fb9c5b018d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:25.340 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:25.341 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:25.341 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:25.341 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:25.341 7fb9c5b018d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:25.342 7fb9c5b018d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:29.341 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:29.347 7fb9c5b05048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:29.347 7fb9c5b05048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:29.348 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:29.348 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:29.348 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:29.348 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:29.349 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:33.349 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:33.350 7fb9c5b05048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:33.350 7fb9c5b05048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:33.351 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:33.352 7fb9c5b05048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:33.352 7fb9c5b05048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:33.352 7fb9c5b05048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:37.351 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:37.352 7fb9c65ce438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:37.352 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:37.353 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:37.354 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:37.354 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:41.354 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:41.355 7fb9c65ce438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:41.356 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:41.357 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:41.357 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:41.357 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:45.356 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:45.357 7fb9c65ce438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:45.358 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:45.359 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:45.359 7fb9c65ce438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:45.359 7fb9c65ce438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:45.359 7fb9c65ce438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:49.358 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:49.359 7fb9c5b010f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:49.359 7fb9c5b010f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:49.359 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:49.359 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:49.360 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:49.360 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:49.364 7fb9c5b010f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:49.364 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:49.364 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:49.365 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:49.365 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:49.365 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:49.365 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:53.359 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:53.363 7fb9c5b010f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:53.363 7fb9c5b010f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:53.363 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:53.364 7fb9c5b010f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:53.365 7fb9c5b010f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:53.365 7fb9c5b010f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:57.364 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:05:57.365 7fb9c955bac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:57.366 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:05:57.367 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:57.367 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:05:57.371 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:05:57.372 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:01.367 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:01.368 7fb9c955bac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:01.368 7fb9c955bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:01.368 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:01.368 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:01.369 7fb9c955bac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:05.369 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:05.372 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:05.373 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:09.374 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:09.375 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:09.376 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:13.376 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:13.377 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:13.378 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:17.378 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:17.379 7fb9c5a8c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:17.379 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:17.379 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:17.379 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:17.380 7fb9c5a8c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:21.380 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:21.381 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:21.382 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:25.384 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:25.388 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:25.389 7fb9c5b11f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:29.389 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:29.390 7fb9c59da8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:29.391 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:29.392 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:29.392 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:29.392 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:29.392 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:29.392 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:33.392 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:33.393 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:33.394 7fb9c59da8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:37.394 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:37.396 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:37.397 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:41.397 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:41.401 7fb9c6595240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:41.402 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:41.403 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:41.403 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:41.403 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:41.403 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:45.403 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:45.404 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:45.405 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:49.404 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:49.406 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.49:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.49:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:49.407 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:53.407 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:53.409 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760936693309390 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.49:8086, 10.0.0.48:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 10/20/2025 05:06:53.410 7fb9c6595240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:06:57.410 7fb9c5b05cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [INFO]: Session Event: TCP Connected 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:06:57.411 7fb9c5b05cc0 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/20/2025 05:06:57.412 7fb9c5b05cc0 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 10/20/2025 05:06:57.412 7fb9c5b05cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/20/2025 05:06:57.412 7fb9c5b05cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/20/2025 05:06:57.412 7fb9c5b05cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/20/2025 05:06:57.412 7fb9c5b0b048 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/20/2025 05:06:57.413 7fb9c5b0b048 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/20/2025 05:07:07.023 7fb9c5aff4e0 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 10/20/2025 05:07:07.024 7fb9c5aff4e0 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/20/2025 05:07:07.024 7fb9c64ca978 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/20/2025 05:07:07.024 7fb9c64ca978 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 10/20/2025 05:07:07.025 7fb9c64ca978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:07:07.025 7fb9c64ca978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/20/2025 05:07:07.025 7fb9c64ca978 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/20/2025 05:07:07.025 7fb9c64cbc18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/20/2025 05:07:07.026 7fb9c64cbc18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/20/2025 05:07:17.158 7fb9c5aff4e0 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001296 10/20/2025 05:07:17.159 7fb9c5aff4e0 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/20/2025 05:07:17.159 7fb9c64cbc18 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/20/2025 05:07:17.159 7fb9c64cbc18 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 2 10/20/2025 05:07:17.159 7fb9c64cbc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:07:17.160 7fb9c64cbc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/20/2025 05:11:14.059 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 10/20/2025 05:11:14.090 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/20/2025 05:11:14.109 7fb9cf7e40c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/20/2025 05:11:14.112 7fb9c719f198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/20/2025 05:11:14.168 7fb9c719f198 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/20/2025 05:11:24.485 7f3e3c3196c8 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/20/2025 05:11:24.486 7f3e3c3196c8 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/20/2025 05:11:24.486 7f3e3c3196c8 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/20/2025 05:11:24.487 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.254:2181,10.0.0.48:2181,10.0.0.49:2181 10/20/2025 05:11:24.487 7f3e3c3196c8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:11:24.489 7f3e331b5e10 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 10/20/2025 05:11:24.489 7f3e331b5e10 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 10/20/2025 05:11:24.490 7f3e3314b780 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 10/20/2025 05:11:24.490 7f3e3314b780 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.491 7f3e3314b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.492 7f3e3314b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1760937084490691 collector_name = collector_ip = collector_list = [ 10.0.0.48:8086, 10.0.0.254:8086, 10.0.0.49:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 10/20/2025 05:11:24.492 7f3e3314b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.503 7f3e331730f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.503 7f3e331730f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/20/2025 05:11:24.503 7f3e331730f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.542 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.254:9041', '10.0.0.48:9041', '10.0.0.49:9041'] 10/20/2025 05:11:24.542 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 10/20/2025 05:11:24.542 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 10/20/2025 05:11:24.543 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 10/20/2025 05:11:24.543 7f3e33111780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.543 7f3e33111780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:11:24.543 7f3e33111780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.544 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 10/20/2025 05:11:24.587 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 10/20/2025 05:11:24.589 7f3e3312f240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.589 7f3e3312f240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:11:24.589 7f3e3312f240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.597 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 10/20/2025 05:11:24.597 7f3e360b14e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.597 7f3e360b14e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/20/2025 05:11:24.597 7f3e360b14e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.605 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 10/20/2025 05:11:24.661 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 10/20/2025 05:11:24.662 7f3e3305aa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.662 7f3e3305aa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/20/2025 05:11:24.662 7f3e3305aa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.808 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//', 'pyamqp://guest:guest@10.0.0.49:5673//'] 10/20/2025 05:11:24.819 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:11:24.820 7f3e32619240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/20/2025 05:11:28.491 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/20/2025 05:11:28.492 7f3e326dd240 [contrail-api] [INFO]: Session Event: TCP Connected 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4371-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.48:2181, 10.0.0.49:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.48:9041, 10.0.0.49:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.48:5673, 10.0.0.49:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/20/2025 05:11:28.493 7f3e326dd240 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 10/20/2025 05:11:28.494 7f3e326dd240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/20/2025 05:11:28.494 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/20/2025 05:11:28.494 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/20/2025 05:11:28.494 7f3e326f1a20 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/20/2025 05:11:28.495 7f3e326f1a20 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/20/2025 05:11:28.499 7f3e326f18d0 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001017 10/20/2025 05:11:28.500 7f3e326f18d0 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/20/2025 05:11:28.501 7f3e326dd240 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/20/2025 05:11:28.501 7f3e326dd240 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 10/20/2025 05:11:28.502 7f3e326dd240 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:11:28.502 7f3e326dd240 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/20/2025 05:11:28.502 7f3e326dd240 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/20/2025 05:11:28.502 7f3e326f14e0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/20/2025 05:11:28.503 7f3e326f14e0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/20/2025 05:14:55.050 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 10/20/2025 05:14:55.067 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/20/2025 05:14:55.079 7f3e3c3196c8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/20/2025 05:14:55.083 7f3e3a41f2e8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/20/2025 05:14:55.097 7f3e3a41f2e8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/20/2025 05:14:55.411 7f3e327c3a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.254_0 10/20/2025 05:14:55.411 7f3e327c3a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly-r24.1-centos) 10/20/2025 05:14:55.417 7f3e327c3a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (nightly-r24.1-centos) 10/20/2025 05:14:55.420 7f3e327c3a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running walk 10/20/2025 05:14:55.516 7f3e327c3a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 10/20/2025 05:14:55.536 7f3e327c3a20 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Time elapsed in resyncing db: 0:00:00.124486 10/20/2025 05:14:55.537 7f3e33ce0828 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-1c92023f-ce54-4817-86db-3381c5749b0d', 'type': 'application_policy_set', 'uuid': 'e86fbf4c-0a96-4cb1-a777-88eec99fe04d'} 10/20/2025 05:14:55.542 7f3e33ce0828 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 10/20/2025 05:14:55.544 7f3e33ce0828 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-c755eb93-4084-46ba-9ae9-6254324855c6', 'type': 'network_ipam', 'uuid': '4b46bd5d-d129-44cc-afa6-e5a12d526813'} 10/20/2025 05:14:55.548 7f3e33ce0828 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-6925918f-ae72-44fa-b2a0-6b9715b3e0c4', 'type': 'project', 'uuid': '61f01ab5-71f6-46e5-b06d-ece102dbdebb'} 10/20/2025 05:14:55.553 7f3e33ce0828 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 10/20/2025 05:14:55.756 7f3e3c3196c8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 10/20/2025 05:14:55.893 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting consumer greenlet 10/20/2025 05:14:55.893 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 10/20/2025 05:14:55.893 7f3e331338d0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting publisher greenlet 10/20/2025 05:14:55.893 7f3e331338d0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Publisher connection 10/20/2025 05:14:55.894 7f3e3c3196c8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-4371-1..dummy 10/20/2025 05:14:55.894 7f3e3c3196c8 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:14:55.915 7f3e3312fe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/20/2025 05:14:55.915 7f3e331338d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 10/20/2025 05:14:55.922 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4371-1..dummy'] 10/20/2025 05:14:55.937 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 10/20/2025 05:14:55.941 7f3e3312fe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/20/2025 05:14:55.945 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4371-1..dummy'] 10/20/2025 05:15:00.982 7f3e33ce0828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/20/2025 05:15:00.990 7f3e3312fe10 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiError: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 187, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 10/20/2025 05:15:01.090 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 10/20/2025 05:15:04.097 7f3e32233b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:15:04.101 7f3e32233b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:15:16.735 7f3e34928588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:15:16.740 7f3e34928588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:15:21.025 7f3e33ce0828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 10/20/2025 05:15:21.113 7f3e3312fe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/20/2025 05:15:21.118 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4371-1..dummy'] 10/20/2025 05:15:23.682 7f3e33ce0828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/20/2025 05:15:23.688 7f3e3312fe10 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiError: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 187, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 10/20/2025 05:15:23.788 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 10/20/2025 05:15:29.086 7f3e32106f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:15:29.092 7f3e32106f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:15:41.386 7f3e321a12e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:15:41.391 7f3e321a12e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:15:53.642 7f3e3210a0f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:15:53.646 7f3e3210a0f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:15:55.086 7f3e326dd048 [contrail-api] [ERROR]: __default__ [SYS_ERR]: VncApiError: Error in rabbitmq heartbeat greenlet for publish: [Errno 32] Broken pipe 10/20/2025 05:16:05.777 7f3e32102828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:16:05.784 7f3e32102828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:16:18.321 7f3e32163780 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:16:18.325 7f3e32163780 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:16:30.624 7f3e321720f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:16:30.628 7f3e3210ae10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:16:42.751 7f3e3210acc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:16:42.755 7f3e3312f390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:16:55.089 7f3e321024e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:16:55.092 7f3e321024e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:17:07.480 7f3e32161438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:17:07.484 7f3e32161438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:17:19.929 7f3e3213eb70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:17:19.933 7f3e3213eb70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:17:32.141 7f3e330e1a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:17:32.145 7f3e330e1a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:17:44.485 7f3e3213b048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:17:44.489 7f3e3213b048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:17:56.978 7f3e3213b048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:17:56.981 7f3e3213b048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:18:09.264 7f3e321a5780 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:18:09.268 7f3e321a5780 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:18:21.768 7f3e321a5780 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:18:21.771 7f3e321a5780 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:18:33.846 7f3e32139390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:18:33.850 7f3e32139390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:18:46.095 7f3e32139390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:18:46.100 7f3e32139390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:18:58.246 7f3e3210a588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:18:58.249 7f3e3210a588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:19:10.492 7f3e3210a588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:19:10.495 7f3e321a5cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:19:23.000 7f3e321a5cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:19:23.004 7f3e321a5cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:19:35.185 7f3e32172390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:19:35.189 7f3e32172390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:19:47.382 7f3e32172390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:19:47.386 7f3e32172390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:19:59.360 7f3e32172588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:19:59.364 7f3e32172588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:20:11.558 7f3e32172588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:20:11.562 7f3e321020f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:20:24.063 7f3e321aab70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:20:24.067 7f3e321aab70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:20:36.203 7f3e3210c588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:20:36.206 7f3e3210c588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:20:48.214 7f3e3210a048 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:20:48.217 7f3e3210a048 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:00.552 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:00.555 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:12.722 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:12.726 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:25.295 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:25.299 7f3e3210ad68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:32.116 7f3e33ce0828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 10/20/2025 05:21:32.119 7f3e3312fe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/20/2025 05:21:32.138 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4371-1..dummy'] 10/20/2025 05:21:33.765 7f3e33ce0828 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/20/2025 05:21:33.767 7f3e3312fe10 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiError: KombuAmqpClient: Connection error in Kombu amqp consumer greenlet: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/kombu_amqp.py", line 187, in _start_consuming self._connection.drain_events(timeout=1) File "/usr/local/lib/python3.6/site-packages/kombu/connection.py", line 318, in drain_events return self.transport.drain_events(self.connection, **kwargs) File "/usr/local/lib/python3.6/site-packages/kombu/transport/pyamqp.py", line 135, in drain_events return connection.drain_events(**kwargs) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 526, in drain_events while not self.blocking_read(timeout): File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 532, in blocking_read return self.on_inbound_frame(frame) File "/usr/local/lib/python3.6/site-packages/amqp/method_framing.py", line 53, in on_frame callback(channel, method_sig, buf, None) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 539, in on_inbound_method method_sig, payload, content, File "/usr/local/lib/python3.6/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method listener(*args) File "/usr/local/lib/python3.6/site-packages/amqp/connection.py", line 669, in _on_close (class_id, method_id), ConnectionError) amqp.exceptions.ConnectionForced: (0, 0): (320) CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' 10/20/2025 05:21:33.868 7f3e3312fe10 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 10/20/2025 05:21:37.477 7f3e32128f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:37.480 7f3e32128f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:49.661 7f3e32133c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:49.665 7f3e32133c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:51.979 7f3e32133c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:51.983 7f3e32133c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:21:54.190 7f3e320bb2e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:21:54.197 7f3e320bb2e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/20/2025 05:22:31.096 7f3e32102828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/20/2025 05:22:31.099 7f3e32102828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map