07/24/2025 06:34:36.092 7f4c5da5d548 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/24/2025 06:34:36.092 7f4c5da5d548 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/24/2025 06:34:36.093 7f4c5da5d548 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/24/2025 06:34:36.094 7f4c551aa2e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 07/24/2025 06:34:36.094 7f4c551aa2e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/24/2025 06:34:36.094 7f4c551aa2e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1753338876094707 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/24/2025 06:34:36.095 7f4c551aa2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.139 7f4c5da5d548 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 07/24/2025 06:34:36.148 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:34:36.149 7f4c550f9588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.154 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/24/2025 06:34:36.154 7f4c550f9240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.155 7f4c550f9240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 06:34:36.155 7f4c550f9240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.167 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/24/2025 06:34:36.167 7f4c550f90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.168 7f4c550f90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:34:36.168 7f4c550f90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.172 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/24/2025 06:34:36.172 7f4c639ad978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.173 7f4c639ad978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/24/2025 06:34:36.173 7f4c639ad978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.183 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 07/24/2025 06:34:36.183 7f4c5da5d548 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/24/2025 06:34:36.184 7f4c5da5d548 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/24/2025 06:34:36.184 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/24/2025 06:34:36.184 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 07/24/2025 06:34:36.184 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/24/2025 06:34:36.184 7f4c57942978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 07/24/2025 06:34:36.185 7f4c57942978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 07/24/2025 06:34:36.185 7f4c550ba588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.185 7f4c550ba588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:36.185 7f4c550ba588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.186 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/24/2025 06:34:36.207 7f4c5aa346d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/24/2025 06:34:36.207 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 07/24/2025 06:34:36.211 7f4c57942978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 07/24/2025 06:34:36.247 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/24/2025 06:34:36.248 7f4c54f09e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.248 7f4c54f09e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/24/2025 06:34:36.248 7f4c54f09e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.254 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/24/2025 06:34:36.254 7f4c54f0ee10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.254 7f4c54f0ee10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:36.254 7f4c54f0ee10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:36.259 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/24/2025 06:34:36.288 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/24/2025 06:34:38.205 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:39.289 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 07/24/2025 06:34:39.297 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:40.094 7f4c54eabc18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:40.096 7f4c54eabc18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:34:40.097 7f4c54eabc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:40.780 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:41.505 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:34:41.511 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:43.529 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:44.096 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:34:44.097 7f4c57929ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:34:44.097 7f4c57929ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:34:44.097 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:34:44.098 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:44.677 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 07/24/2025 06:34:44.682 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:47.154 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:48.098 7f4c54e974e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:34:48.099 7f4c54e974e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:48.100 7f4c54e974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:48.101 7f4c54e974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:48.101 7f4c54e974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:48.101 7f4c54e974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:34:48.101 7f4c54e974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:48.664 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:34:48.668 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:50.545 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:50.547 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 07/24/2025 06:34:50.550 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:52.101 7f4c5a78b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:52.103 7f4c5a78b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:34:52.104 7f4c5a78b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:53.609 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:34:54.719 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:34:54.724 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:34:54.725 7f4c551aa048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.725 7f4c551aa048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:34:54.725 7f4c551aa048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.740 7f4c5da5d548 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 07/24/2025 06:34:54.741 7f4c5462b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.742 7f4c5462b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/24/2025 06:34:54.742 7f4c5462b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.751 7f4c54ec8d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.751 7f4c54ec8d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:34:54.751 7f4c54ec8d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:54.758 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 07/24/2025 06:34:54.758 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 07/24/2025 06:34:54.758 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/24/2025 06:34:54.759 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3714-3. 07/24/2025 06:34:54.762 7f4c5aa346d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/24/2025 06:34:54.862 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3714-3.'] 07/24/2025 06:34:54.877 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/24/2025 06:34:54.881 7f4c5aa346d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/24/2025 06:34:54.920 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3714-3.'] 07/24/2025 06:34:55.269 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Fetching all containers 07/24/2025 06:34:55.312 7f4c5da5d548 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 07/24/2025 06:34:55.477 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..config_queue 07/24/2025 06:34:55.477 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..tftp_queue 07/24/2025 06:34:55.939 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/24/2025 06:34:55.946 7f4c5aa346d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/24/2025 06:34:55.978 7f4c5da5d548 [contrail-device-manager] [WARNING]: Process 140 prepared to run in Full mode... 07/24/2025 06:34:55.978 7f4c5da5d548 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 07/24/2025 06:34:55.978 7f4c5da5d548 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 07/24/2025 06:34:55.981 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 07/24/2025 06:34:55.981 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 07/24/2025 06:34:55.982 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 07/24/2025 06:34:55.982 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 07/24/2025 06:34:55.983 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 07/24/2025 06:34:55.983 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 07/24/2025 06:34:55.986 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 07/24/2025 06:34:55.986 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 07/24/2025 06:34:55.986 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 07/24/2025 06:34:55.986 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 07/24/2025 06:34:55.987 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 07/24/2025 06:34:55.988 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 07/24/2025 06:34:55.989 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 07/24/2025 06:34:55.990 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 07/24/2025 06:34:55.991 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 07/24/2025 06:34:55.992 7f4c5da5d548 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 07/24/2025 06:34:55.994 7f4c5da5d548 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 07/24/2025 06:34:56.007 7f4c545dc198 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 07/24/2025 06:34:56.008 7f4c545dc198 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 07/24/2025 06:34:56.052 7f4c4fdb0a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.052 7f4c4fdb0a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:34:56.052 7f4c4fdb0a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.064 7f4c4fc9e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.065 7f4c4fc9e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:34:56.065 7f4c4fc9e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.103 7f4c4fc9e240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:34:56.104 7f4c4fc9e240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:34:56.104 7f4c4fc9e240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:34:56.104 7f4c4fc9e240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:34:56.105 7f4c4fc9e240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:34:56.279 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3714-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/24/2025 06:34:56.322 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/24/2025 06:34:56.335 7f4c5aa346d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/24/2025 06:34:56.402 7f4c5aa346d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3714-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3714-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/24/2025 06:35:00.105 7f4c4fbcee10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:00.106 7f4c4fbcee10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:00.107 7f4c4fbcee10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/24/2025 06:35:00.108 7f4c4fbcee10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:00.108 7f4c4fbcee10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:00.108 7f4c4fbcee10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:00.108 7f4c4fbcee10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:02.200 7f4c4fc3fcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:02.200 7f4c4fc3fcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:02.200 7f4c4fc3fcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:04.108 7f4c4fc16e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:04.110 7f4c4fc16e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:04.111 7f4c4fc16e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:04.111 7f4c4fc16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:04.111 7f4c4fc16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:04.112 7f4c4fc16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:04.112 7f4c4fc16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:04.112 7f4c4fc16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:04.112 7f4c4fc16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:08.110 7f4c57e346d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:08.111 7f4c57e346d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:08.112 7f4c57e346d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:12.112 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:12.113 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:12.113 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:12.113 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:12.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:16.114 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:16.115 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:16.116 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:16.117 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:16.117 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:16.117 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:16.117 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:20.117 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:20.118 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:20.118 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:20.118 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:20.118 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:20.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:24.119 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:24.121 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:24.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:28.122 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:28.124 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:28.125 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:32.125 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:32.126 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:32.127 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:36.128 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:36.130 7f4c4fd064e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:36.131 7f4c4fd064e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:40.131 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:40.175 7f4c54629240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:40.175 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:40.175 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:40.176 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:44.176 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:44.177 7f4c54629240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:44.178 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:44.178 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:44.178 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:44.178 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:44.178 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:44.179 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:48.178 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:48.179 7f4c54629240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:48.180 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:48.181 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:48.181 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:52.180 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:52.182 7f4c54629240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:52.183 7f4c54629240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:56.183 7f4c4fb4d198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:35:56.184 7f4c4fb4d198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:35:56.185 7f4c4fb4d198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:00.185 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:00.186 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:00.187 7f4c5c6de4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:04.186 7f4c5ac4d048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:04.188 7f4c5ac4d048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:04.189 7f4c5ac4d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:08.189 7f4c4fb72f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:08.190 7f4c4fb72f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:08.191 7f4c4fb72f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:12.190 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:12.192 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:12.193 7f4c57929ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:16.192 7f4c4fb72e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:16.194 7f4c4fb72e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:16.195 7f4c4fb72e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:20.194 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:20.195 7f4c5ac8fe10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:20.195 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:20.195 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:20.196 7f4c5ac8fe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:24.196 7f4c5ac16e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:24.197 7f4c5ac16e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:24.198 7f4c5ac16e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.066 7f4c5da5d548 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/24/2025 06:36:26.066 7f4c5da5d548 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/24/2025 06:36:26.066 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/24/2025 06:36:26.067 7f4c5be38d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.067 7f4c5be38d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:26.067 7f4c5be38d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.068 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/24/2025 06:36:26.124 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/24/2025 06:36:26.125 7f4c4fd26a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.126 7f4c4fd26a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/24/2025 06:36:26.126 7f4c4fd26a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.132 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/24/2025 06:36:26.132 7f4c4fd26828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.132 7f4c4fd26828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:26.132 7f4c4fd26828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:26.147 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:26.834 7f4c5da5d548 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 07/24/2025 06:36:26.839 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:26.850 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:27.778 7f4c5da5d548 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 07/24/2025 06:36:27.784 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:27.784 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/24/2025 06:36:27.865 7f4c5da5d548 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/24/2025 06:36:27.873 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:28.198 7f4c4fb350f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:28.199 7f4c4fb350f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:28.200 7f4c4fb350f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:28.829 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 07/24/2025 06:36:28.837 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:28.849 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:29.834 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:36:29.840 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:29.848 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:30.594 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 07/24/2025 06:36:30.605 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:30.614 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:31.711 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:36:31.716 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:31.728 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:32.200 7f4c4fb224e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:32.201 7f4c4fb224e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:32.202 7f4c4fb224e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:32.716 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 07/24/2025 06:36:32.721 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:32.730 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:33.832 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:36:33.837 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:33.845 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:34.653 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 07/24/2025 06:36:34.657 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:34.664 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/24/2025 06:36:35.657 7f4c5da5d548 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 07/24/2025 06:36:35.661 7f4c5da5d548 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/24/2025 06:36:35.662 7f4c4fc836d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.662 7f4c4fc836d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:35.662 7f4c4fc836d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.712 7f4c5da5d548 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 07/24/2025 06:36:35.712 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:36:35.713 7f4c4fb1b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.730 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/24/2025 06:36:35.731 7f4c4fb1b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.731 7f4c4fb1b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:35.731 7f4c4fb1b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.785 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/24/2025 06:36:35.786 7f4c4fb1b588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.786 7f4c4fb1b588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:36:35.786 7f4c4fb1b588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.798 7f4c5da5d548 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/24/2025 06:36:35.798 7f4c4fb1b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.799 7f4c4fb1b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:35.799 7f4c4fb1b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.800 7f4c4fb98c18 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/24/2025 06:36:35.800 7f4c4fc82e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.801 7f4c4fc82e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/24/2025 06:36:35.801 7f4c4fc82e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.810 7f4c4fb98c18 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/24/2025 06:36:35.810 7f4c4fc4eb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:35.810 7f4c4fc4eb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:35.810 7f4c4fc4eb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:36.201 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:36.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:36.204 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:40.203 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:40.205 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:40.206 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:44.206 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:44.207 7f4c4fb4e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:44.208 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:44.209 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:44.209 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:48.209 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:48.210 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:48.211 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:52.212 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:52.213 7f4c4fb4e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/24/2025 06:36:52.213 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:52.213 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:52.213 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 140 http_port = 8096 start_time = 1753338876094707 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.50:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/24/2025 06:36:52.214 7f4c4fb4e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/24/2025 06:36:55.634 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'id_perms': {'created': '2025-07-24T06:36:55.622209', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:36:55.622209', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11256838356048686837, 'uuid_mslong': 5984989727265669821}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '530ef472-7608-42bd-9c38-52d7f2462ef5'}, 'oper': 'CREATE', 'request-id': 'req-788b1d03-3193-44fd-b456-9632c95178d3', 'type': 'analytics_node', 'uuid': '530ef472-7608-42bd-9c38-52d7f2462ef5'} 07/24/2025 06:36:55.706 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'id_perms': {'created': '2025-07-24T06:36:55.695317', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:36:55.695317', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9494544491972816831, 'uuid_mslong': 8052423789229851831}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6fbff4c5-d1f3-44b7-83c3-65e9442e6fbf'}, 'oper': 'CREATE', 'request-id': 'req-6d183d46-5892-4c12-a101-be15ba8a315b', 'type': 'analytics_node', 'uuid': '6fbff4c5-d1f3-44b7-83c3-65e9442e6fbf'} 07/24/2025 06:36:55.755 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'id_perms': {'created': '2025-07-24T06:36:55.747148', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:36:55.747148', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11576265662888554591, 'uuid_mslong': 6400699764997639137}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '58d3da86-1e9c-4be1-a0a7-28496606305f'}, 'oper': 'CREATE', 'request-id': 'req-52f108d5-77b9-4f98-ade6-0b3da825e8c2', 'type': 'analytics_node', 'uuid': '58d3da86-1e9c-4be1-a0a7-28496606305f'} 07/24/2025 06:36:56.214 7f4c4fb2c630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/24/2025 06:36:56.215 7f4c4fb2c630 [contrail-device-manager] [INFO]: Session Event: TCP Connected 07/24/2025 06:36:56.215 7f4c4fb2c630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/24/2025 06:36:56.215 7f4c4fb2c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3714-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/24/2025 06:36:56.216 7f4c4fb2c630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/24/2025 06:36:56.216 7f4c4fac8e10 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/24/2025 06:36:56.217 7f4c4fac8e10 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/24/2025 06:37:06.236 7f4c4fac86d8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 07/24/2025 06:37:06.236 7f4c4fac86d8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/24/2025 06:37:06.237 7f4c54f64cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/24/2025 06:37:06.237 7f4c54f64cc0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 07/24/2025 06:37:06.237 7f4c54f64cc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/24/2025 06:37:06.237 7f4c54f64cc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 06:37:06.238 7f4c54f64cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/24/2025 06:37:06.238 7f4c4fac7630 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/24/2025 06:37:06.239 7f4c4fac7630 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/24/2025 06:37:11.258 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'id_perms': {'created': '2025-07-24T06:37:11.230259', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:11.230259', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11029644202030303861, 'uuid_mslong': 6867612183564468234}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5f4ea8e5-1081-400a-9911-2af6d4f68a75'}, 'oper': 'CREATE', 'request-id': 'req-1b0dc0da-26d5-47ae-808a-29ba3a6d23a0', 'type': 'analytics_alarm_node', 'uuid': '5f4ea8e5-1081-400a-9911-2af6d4f68a75'} 07/24/2025 06:37:12.126 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'id_perms': {'created': '2025-07-24T06:37:12.109122', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:12.109122', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13641223081263477041, 'uuid_mslong': 16733756516074405891}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e83a3ee4-627e-4003-bd4f-5c1e3c91b131'}, 'oper': 'CREATE', 'request-id': 'req-a6f60745-9b79-4054-b8ee-c2a859454128', 'type': 'analytics_alarm_node', 'uuid': 'e83a3ee4-627e-4003-bd4f-5c1e3c91b131'} 07/24/2025 06:37:12.164 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'id_perms': {'created': '2025-07-24T06:37:12.149525', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:12.149525', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10638023535830160649, 'uuid_mslong': 2653365930032778083}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '24d2a641-56ba-4b63-93a1-da0b0d66d509'}, 'oper': 'CREATE', 'request-id': 'req-4582353a-b7e2-4e33-810b-1b8fc9303cea', 'type': 'analytics_alarm_node', 'uuid': '24d2a641-56ba-4b63-93a1-da0b0d66d509'} 07/24/2025 06:37:17.416 7f4c4fac86d8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 07/24/2025 06:37:17.417 7f4c4fac86d8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/24/2025 06:37:17.417 7f4c5ac16c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/24/2025 06:37:17.417 7f4c5ac16c18 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 07/24/2025 06:37:17.417 7f4c5ac16c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/24/2025 06:37:17.417 7f4c5ac16c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/24/2025 06:37:22.902 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-2.'], 'id_perms': {'created': '2025-07-24T06:37:22.887620', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:22.887620', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12252554041263330244, 'uuid_mslong': 588162322355273934}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '08299284-1641-40ce-aa09-d0fbd4c713c4'}, 'oper': 'CREATE', 'request-id': 'req-e2656930-cd1b-42ab-a169-afa3db858b9d', 'type': 'analytics_snmp_node', 'uuid': '08299284-1641-40ce-aa09-d0fbd4c713c4'} 07/24/2025 06:37:22.919 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-3.'], 'id_perms': {'created': '2025-07-24T06:37:22.891742', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:22.891742', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10777324036690695409, 'uuid_mslong': 15744512986903298330}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'da7fbf24-c1e5-411a-9590-bf1c543a54f1'}, 'oper': 'CREATE', 'request-id': 'req-b1b3db8f-4334-4065-900d-8432a30ed9bd', 'type': 'analytics_snmp_node', 'uuid': 'da7fbf24-c1e5-411a-9590-bf1c543a54f1'} 07/24/2025 06:37:22.988 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3714-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3714-1.'], 'id_perms': {'created': '2025-07-24T06:37:22.979700', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:37:22.979700', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12541685427183616716, 'uuid_mslong': 797799510306474911}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0b125a6d-7dcc-4b9f-ae0d-047283f902cc'}, 'oper': 'CREATE', 'request-id': 'req-27a18ea8-3ca3-49c2-af72-3af143a825b9', 'type': 'analytics_snmp_node', 'uuid': '0b125a6d-7dcc-4b9f-ae0d-047283f902cc'} 07/24/2025 06:39:06.755 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-45002904-4179-42cf-b4ad-0b8fdcead3ec', 'type': 'global_system_config', 'uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994'} 07/24/2025 06:39:06.893 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3714-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-1'], 'id_perms': {'created': '2025-07-24T06:39:06.873927', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:39:06.873927', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10673248482876663222, 'uuid_mslong': 1471645133622756370}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '146c5573-b104-4412-941e-fef2255725b6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-605d9d66-b87d-4b97-8ae1-07b9ee9ad69e', 'type': 'virtual_router', 'uuid': '146c5573-b104-4412-941e-fef2255725b6'} 07/24/2025 06:39:07.276 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-1', 'vhost0'], 'id_perms': {'created': '2025-07-24T06:39:07.242212', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:39:07.242212', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12296674136929878653, 'uuid_mslong': 4729909455591457971}}, 'parent_type': 'virtual-router', 'parent_uuid': '146c5573-b104-4412-941e-fef2255725b6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '41a40396-f84a-44b3-aaa6-8ffa1a70427d', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:41:a4:03:96:f8']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '849f7cc7-7836-4f32-a7bb-d62b962f9490'}]}, 'oper': 'CREATE', 'request-id': 'req-3076d2a7-b661-4773-9267-cc6234aa6ade', 'type': 'virtual_machine_interface', 'uuid': '41a40396-f84a-44b3-aaa6-8ffa1a70427d'} 07/24/2025 06:39:07.332 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-3076d2a7-b661-4773-9267-cc6234aa6ade', 'type': 'virtual_machine_interface', 'uuid': '41a40396-f84a-44b3-aaa6-8ffa1a70427d'} 07/24/2025 06:39:07.814 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-befd7f0c-623c-4fef-8253-eec35734836c', 'type': 'access_control_list', 'uuid': '0d304de0-95e7-4a89-93fe-150958fe0dfa'} 07/24/2025 06:39:58.925 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3714-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-2'], 'id_perms': {'created': '2025-07-24T06:39:58.916383', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:39:58.916383', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10309367934322498758, 'uuid_mslong': 11563772748602754383}}, 'parent_type': 'global-system-config', 'parent_uuid': 'cca7bcae-f3dd-4ef2-bd5f-2708a1f6d994', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a07ac60c-1fcf-454f-8f12-3b83d0185cc6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-fcd1b71a-106c-4179-801e-962bea1f4c51', 'type': 'virtual_router', 'uuid': 'a07ac60c-1fcf-454f-8f12-3b83d0185cc6'} 07/24/2025 06:39:59.361 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-2', 'vhost0'], 'id_perms': {'created': '2025-07-24T06:39:59.335889', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-24T06:39:59.335889', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12846124812883995019, 'uuid_mslong': 9243824517073423121}}, 'parent_type': 'virtual-router', 'parent_uuid': 'a07ac60c-1fcf-454f-8f12-3b83d0185cc6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8048a96c-2235-4b11-b246-9a74a448298b', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:80:48:a9:6c:22']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '849f7cc7-7836-4f32-a7bb-d62b962f9490'}]}, 'oper': 'CREATE', 'request-id': 'req-c60da313-d4db-43a2-9f82-6c091840e08e', 'type': 'virtual_machine_interface', 'uuid': '8048a96c-2235-4b11-b246-9a74a448298b'} 07/24/2025 06:39:59.428 7f4c4fb980f0 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3714-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-c60da313-d4db-43a2-9f82-6c091840e08e', 'type': 'virtual_machine_interface', 'uuid': '8048a96c-2235-4b11-b246-9a74a448298b'} 07/24/2025 06:40:51.746 7f4c5abb0ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/24/2025 06:41:02.942 7f4c4fc8e588 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/24/2025 06:43:09.335 7f4c4fc54630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map