10/06/2025 04:42:30.254 7f6c4c1d6fc8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/06/2025 04:42:30.254 7f6c4c1d6fc8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/06/2025 04:42:30.254 7f6c4c1d6fc8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/06/2025 04:42:30.254 7f6c438d7048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 10/06/2025 04:42:30.254 7f6c438d7048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1759725750255106 collector_name = collector_ip = collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/06/2025 04:42:30.255 7f6c438d7048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.296 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 10/06/2025 04:42:30.304 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/06/2025 04:42:30.304 7f6c438272e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.305 7f6c438272e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:42:30.305 7f6c438272e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.305 7f6c438272e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.305 7f6c438272e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:42:30.305 7f6c438272e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.317 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/06/2025 04:42:30.318 7f6c43827828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.318 7f6c43827828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/06/2025 04:42:30.318 7f6c43827828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.339 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/06/2025 04:42:30.339 7f6c438354e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.340 7f6c438354e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:42:30.340 7f6c438354e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.342 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/06/2025 04:42:30.342 7f6c520d7978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.343 7f6c520d7978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/06/2025 04:42:30.343 7f6c520d7978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.365 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 10/06/2025 04:42:30.365 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/06/2025 04:42:30.365 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/06/2025 04:42:30.365 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/06/2025 04:42:30.366 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 10/06/2025 04:42:30.366 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/06/2025 04:42:30.366 7f6c43827ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 10/06/2025 04:42:30.366 7f6c43827ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 10/06/2025 04:42:30.367 7f6c436c6048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.367 7f6c436c6048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:30.367 7f6c436c6048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.368 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/06/2025 04:42:30.370 7f6c4915d6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/06/2025 04:42:30.370 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 10/06/2025 04:42:30.371 7f6c43827ac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 10/06/2025 04:42:30.399 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/06/2025 04:42:30.400 7f6c43655ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.400 7f6c43655ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/06/2025 04:42:30.400 7f6c43655ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.413 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/06/2025 04:42:30.413 7f6c4365b8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.413 7f6c4365b8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:30.413 7f6c4365b8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:30.430 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/06/2025 04:42:30.458 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/06/2025 04:42:30.740 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:31.506 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 10/06/2025 04:42:31.510 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:33.062 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:33.564 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:42:33.572 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:34.255 7f6c435db198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:34.256 7f6c435db198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:34.257 7f6c435db198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:34.258 7f6c435db198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:34.258 7f6c435db198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:34.258 7f6c435db198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:35.681 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:36.669 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 10/06/2025 04:42:36.673 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:38.257 7f6c47e08d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:38.259 7f6c47e08d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:38.260 7f6c47e08d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:38.260 7f6c47e08d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:38.260 7f6c47e08d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:38.260 7f6c47e08d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:38.260 7f6c47e08d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:38.759 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:39.655 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:42:39.659 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:42.046 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:42.048 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 10/06/2025 04:42:42.051 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:42.260 7f6c435a24e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:42.261 7f6c435a24e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:42.262 7f6c435a24e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:42.263 7f6c435a24e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:42.263 7f6c435a24e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.103 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:42:43.790 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:42:43.794 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:42:43.794 7f6c466008d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.795 7f6c466008d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:42:43.795 7f6c466008d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.824 7f6c4c1d6fc8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 10/06/2025 04:42:43.825 7f6c42d3a978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.825 7f6c42d3a978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 10/06/2025 04:42:43.825 7f6c42d3a978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.837 7f6c42d3a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.837 7f6c42d3a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:42:43.837 7f6c42d3a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:43.838 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 10/06/2025 04:42:43.838 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 10/06/2025 04:42:43.838 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/06/2025 04:42:43.839 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4220-1. 10/06/2025 04:42:43.841 7f6c4915d6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/06/2025 04:42:43.916 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4220-1.'] 10/06/2025 04:42:43.931 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/06/2025 04:42:43.936 7f6c4915d6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/06/2025 04:42:43.954 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4220-1.'] 10/06/2025 04:42:44.353 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Fetching all containers 10/06/2025 04:42:44.448 7f6c4c1d6fc8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 10/06/2025 04:42:44.633 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..config_queue 10/06/2025 04:42:44.634 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..tftp_queue 10/06/2025 04:42:44.970 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/06/2025 04:42:44.973 7f6c4915d6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/06/2025 04:42:45.061 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4220-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..tftp_queue'] 10/06/2025 04:42:45.135 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Process 135 prepared to run in Full mode... 10/06/2025 04:42:45.135 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 10/06/2025 04:42:45.135 7f6c4c1d6fc8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 10/06/2025 04:42:45.138 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 10/06/2025 04:42:45.138 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 10/06/2025 04:42:45.139 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 10/06/2025 04:42:45.139 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 10/06/2025 04:42:45.140 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 10/06/2025 04:42:45.140 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 10/06/2025 04:42:45.143 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 10/06/2025 04:42:45.144 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 10/06/2025 04:42:45.149 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 10/06/2025 04:42:45.149 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 10/06/2025 04:42:45.149 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 10/06/2025 04:42:45.149 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 10/06/2025 04:42:45.150 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 10/06/2025 04:42:45.150 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 10/06/2025 04:42:45.150 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 10/06/2025 04:42:45.150 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 10/06/2025 04:42:45.150 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 10/06/2025 04:42:45.151 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 10/06/2025 04:42:45.151 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 10/06/2025 04:42:45.151 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 10/06/2025 04:42:45.151 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 10/06/2025 04:42:45.152 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 10/06/2025 04:42:45.153 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 10/06/2025 04:42:45.155 7f6c4c1d6fc8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 10/06/2025 04:42:45.159 7f6c42c70f60 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 10/06/2025 04:42:45.159 7f6c42c70f60 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 10/06/2025 04:42:45.227 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:45.228 7f6c424cdd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:45.228 7f6c424cdd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:45.239 7f6c4359ee10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:45.240 7f6c4359ee10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:45.240 7f6c4359ee10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:46.115 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/06/2025 04:42:46.145 7f6c4915d6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/06/2025 04:42:46.247 7f6c4915d6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4220-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4220-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 10/06/2025 04:42:46.262 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:46.263 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:46.264 7f6c424cdd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:50.264 7f6c423a2048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:50.265 7f6c423a2048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:50.266 7f6c423a2048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:50.267 7f6c423a2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:51.363 7f6c42245630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:51.363 7f6c42245630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:42:51.363 7f6c42245630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:54.267 7f6c435a3978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:54.268 7f6c435a3978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:54.269 7f6c435a3978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:58.268 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:42:58.269 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:42:58.269 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:42:58.270 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:58.271 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:42:58.271 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:42:58.271 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:02.272 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:02.273 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:02.273 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:02.274 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:02.275 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:02.275 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:02.275 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:02.275 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:02.275 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:06.275 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:06.277 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:06.277 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:06.277 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:06.278 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:06.279 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:06.279 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:06.279 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:06.279 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:10.278 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:10.279 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:10.279 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:10.279 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:10.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:14.280 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:14.282 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:14.283 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:14.283 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:14.283 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:14.283 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:14.283 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:18.283 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:18.284 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:18.284 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:18.284 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:18.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:22.285 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:22.286 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:22.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:22.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:26.287 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:26.290 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:26.291 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:26.291 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:26.291 7f6c4235f0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:26.291 7f6c4235f0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:26.291 7f6c4235f0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:30.291 7f6c435ac8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:30.292 7f6c435ac8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:30.293 7f6c435ac8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:34.293 7f6c435a9c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:34.296 7f6c435a9c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:34.297 7f6c435a9c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:38.296 7f6c4220d8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:38.298 7f6c4220d8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:38.299 7f6c4220d8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:42.298 7f6c4220d2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:42.300 7f6c4220d2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:42.301 7f6c4220d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:46.301 7f6c42206eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:46.302 7f6c42206eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:46.303 7f6c42206eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:46.303 7f6c42206eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:46.303 7f6c42206eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:50.302 7f6c49324240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:50.305 7f6c49324240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:50.305 7f6c49324240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:50.305 7f6c49324240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:50.306 7f6c49324240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:54.306 7f6c42206f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:54.307 7f6c42206f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:54.308 7f6c42206f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:58.307 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:43:58.308 7f6c422e1438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:43:58.308 7f6c422e1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:43:58.308 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:58.308 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:43:58.308 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:43:58.309 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.309 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:02.310 7f6c422e1438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:02.310 7f6c422e1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:02.310 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:02.311 7f6c422e1438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.623 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/06/2025 04:44:02.623 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/06/2025 04:44:02.623 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/06/2025 04:44:02.623 7f6c4222c240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.624 7f6c4222c240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:02.624 7f6c4222c240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.626 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/06/2025 04:44:02.688 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/06/2025 04:44:02.689 7f6c4249f828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.690 7f6c4249f828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/06/2025 04:44:02.690 7f6c4249f828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.699 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/06/2025 04:44:02.701 7f6c4249f6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.701 7f6c4249f6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:02.701 7f6c4249f6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:02.726 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:04.065 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 10/06/2025 04:44:04.071 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:04.089 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:05.166 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 10/06/2025 04:44:05.171 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:05.171 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/06/2025 04:44:05.222 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/06/2025 04:44:05.235 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:05.783 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 10/06/2025 04:44:05.793 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:05.798 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:06.091 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:44:06.095 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:06.105 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:06.311 7f6c421cf828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:06.335 7f6c421cf828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:06.336 7f6c421cf828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:07.253 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 10/06/2025 04:44:07.264 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:07.291 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:07.767 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:44:07.772 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:07.780 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:09.206 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 10/06/2025 04:44:09.212 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:09.221 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:10.139 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:44:10.143 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:10.149 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:10.336 7f6c4243a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:10.341 7f6c4243a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:10.341 7f6c4243a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:10.341 7f6c4243a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:10.342 7f6c4243a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:10.704 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 10/06/2025 04:44:10.708 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:10.713 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/06/2025 04:44:11.816 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 10/06/2025 04:44:11.822 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/06/2025 04:44:11.823 7f6c421c1eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.823 7f6c421c1eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:11.823 7f6c421c1eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.871 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 10/06/2025 04:44:11.872 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/06/2025 04:44:11.872 7f6c421dc588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.873 7f6c421dc588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:44:11.873 7f6c421dc588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.873 7f6c421dc588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.873 7f6c421dc588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:44:11.873 7f6c421dc588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.877 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/06/2025 04:44:11.877 7f6c421c3d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.878 7f6c421c3d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:11.878 7f6c421c3d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.914 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/06/2025 04:44:11.915 7f6c421c72e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.915 7f6c421c72e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:44:11.915 7f6c421c72e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.918 7f6c4c1d6fc8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/06/2025 04:44:11.919 7f6c421de4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.919 7f6c421de4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:11.919 7f6c421de4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.926 7f6c421c3f60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/06/2025 04:44:11.927 7f6c42445b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.927 7f6c42445b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/06/2025 04:44:11.927 7f6c42445b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.951 7f6c421c3f60 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/06/2025 04:44:11.951 7f6c421c7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:11.951 7f6c421c7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:11.952 7f6c421c7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:14.343 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:14.344 7f6c421dc240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:14.345 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:14.346 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:14.346 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:14.346 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:14.346 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:14.346 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:18.345 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:18.347 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:18.348 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:18.348 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:22.348 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:22.349 7f6c421dc240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:22.349 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:22.349 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:22.349 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:22.349 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:22.350 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:26.350 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:26.352 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 http_port = 8096 start_time = 1759725750255106 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.254:8086, 10.0.0.48:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/06/2025 04:44:26.353 7f6c421dc240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/06/2025 04:44:27.560 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'id_perms': {'created': '2025-10-06T04:44:27.550247', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:27.550247', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11313383738872286811, 'uuid_mslong': 7583657367009185014}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '693e9032-02db-4cf6-9d01-3691d329ce5b'}, 'oper': 'CREATE', 'request-id': 'req-52366230-828a-4234-bfd3-ca7da1d84f24', 'type': 'analytics_node', 'uuid': '693e9032-02db-4cf6-9d01-3691d329ce5b'} 10/06/2025 04:44:27.922 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'id_perms': {'created': '2025-10-06T04:44:27.909570', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:27.909570', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13773560814641504347, 'uuid_mslong': 10184485755838809347}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8d568fd5-d0cc-4503-bf25-8495e0f2605b'}, 'oper': 'CREATE', 'request-id': 'req-40f5070e-ba99-479d-960a-8f86c4c1baf3', 'type': 'analytics_node', 'uuid': '8d568fd5-d0cc-4503-bf25-8495e0f2605b'} 10/06/2025 04:44:27.969 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'id_perms': {'created': '2025-10-06T04:44:27.961384', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:27.961384', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13583275091723334140, 'uuid_mslong': 11565343626645490606}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a0805ac0-ab88-4bae-bc81-7cba8894b1fc'}, 'oper': 'CREATE', 'request-id': 'req-0915fb45-ee85-4759-81df-10b98db0a489', 'type': 'analytics_node', 'uuid': 'a0805ac0-ab88-4bae-bc81-7cba8894b1fc'} 10/06/2025 04:44:30.353 7f6c421cb6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [INFO]: Session Event: TCP Connected 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4220-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/06/2025 04:44:30.354 7f6c421cb6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/06/2025 04:44:30.355 7f6c421cb6d8 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 10/06/2025 04:44:30.355 7f6c421cb6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/06/2025 04:44:30.355 7f6c421cb6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/06/2025 04:44:30.355 7f6c421cb6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/06/2025 04:44:30.355 7f6c421d5828 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/06/2025 04:44:30.356 7f6c421d5828 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/06/2025 04:44:38.082 7f6c421d5a20 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017 10/06/2025 04:44:38.082 7f6c421d5a20 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/06/2025 04:44:38.082 7f6c4220c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/06/2025 04:44:38.083 7f6c4220c0f0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 10/06/2025 04:44:38.083 7f6c4220c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/06/2025 04:44:38.083 7f6c4220c0f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/06/2025 04:44:38.083 7f6c4220c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/06/2025 04:44:38.083 7f6c49185e10 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/06/2025 04:44:38.084 7f6c49185e10 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/06/2025 04:44:42.884 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'id_perms': {'created': '2025-10-06T04:44:42.862171', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:42.862171', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10731187122774144029, 'uuid_mslong': 459209047039821484}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '065f7031-fe74-46ac-94ec-d5d4f732f41d'}, 'oper': 'CREATE', 'request-id': 'req-cbce2658-c2bd-43a4-9dad-36e95d6b5833', 'type': 'analytics_alarm_node', 'uuid': '065f7031-fe74-46ac-94ec-d5d4f732f41d'} 10/06/2025 04:44:43.396 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'id_perms': {'created': '2025-10-06T04:44:43.386347', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:43.386347', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12828824878958544221, 'uuid_mslong': 13343942802650384077}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b92f3547-9f1b-46cd-b209-2441e404855d'}, 'oper': 'CREATE', 'request-id': 'req-d4ae1185-58cc-4888-8736-a839767a10de', 'type': 'analytics_alarm_node', 'uuid': 'b92f3547-9f1b-46cd-b209-2441e404855d'} 10/06/2025 04:44:43.416 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'id_perms': {'created': '2025-10-06T04:44:43.390124', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:43.390124', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13613251813643291439, 'uuid_mslong': 8951126491639270453}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c38ca1e-79bf-4c35-bceb-fc65fe268b2f'}, 'oper': 'CREATE', 'request-id': 'req-69b82875-7cab-4b23-93d4-fa932cb7eb6b', 'type': 'analytics_alarm_node', 'uuid': '7c38ca1e-79bf-4c35-bceb-fc65fe268b2f'} 10/06/2025 04:44:47.950 7f6c421d5a20 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 10/06/2025 04:44:47.950 7f6c421d5a20 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/06/2025 04:44:47.950 7f6c4222ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/06/2025 04:44:47.950 7f6c4222ef60 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 10/06/2025 04:44:47.951 7f6c4222ef60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/06/2025 04:44:47.951 7f6c4222ef60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/06/2025 04:44:51.320 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-1.'], 'id_perms': {'created': '2025-10-06T04:44:51.314550', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:51.314550', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13123576854675196117, 'uuid_mslong': 18437501639335298021}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ffdf2a0e-0e43-43e5-b620-4f9e1d7408d5'}, 'oper': 'CREATE', 'request-id': 'req-28144f89-90eb-449d-aeaa-d981d60e3424', 'type': 'analytics_snmp_node', 'uuid': 'ffdf2a0e-0e43-43e5-b620-4f9e1d7408d5'} 10/06/2025 04:44:51.661 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-3.'], 'id_perms': {'created': '2025-10-06T04:44:51.642413', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:51.642413', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12463003872977792167, 'uuid_mslong': 18410286087768198414}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ff7e79a7-aabd-4d0e-acf5-7bfd9b28aca7'}, 'oper': 'CREATE', 'request-id': 'req-5697169f-a528-406b-98ae-3a27ad449cdc', 'type': 'analytics_snmp_node', 'uuid': 'ff7e79a7-aabd-4d0e-acf5-7bfd9b28aca7'} 10/06/2025 04:44:51.688 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4220-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4220-2.'], 'id_perms': {'created': '2025-10-06T04:44:51.682754', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:44:51.682754', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12219528661973391862, 'uuid_mslong': 13803507163811171320}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bf8fe8a1-a186-4bf8-a994-7c9383a0d9f6'}, 'oper': 'CREATE', 'request-id': 'req-81827a2c-65cf-4afb-946f-c05d336f23bb', 'type': 'analytics_snmp_node', 'uuid': 'bf8fe8a1-a186-4bf8-a994-7c9383a0d9f6'} 10/06/2025 04:46:31.183 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-04d96a0b-4531-40f1-b0b8-66cdf24bce2b', 'type': 'global_system_config', 'uuid': '70faf83e-8667-40be-869e-984939182a8d'} 10/06/2025 04:46:31.229 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-0e959fa0-f651-4b46-a30a-1bd75a5a2a5b', 'type': 'global_system_config', 'uuid': '70faf83e-8667-40be-869e-984939182a8d'} 10/06/2025 04:46:31.317 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4220-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-2'], 'id_perms': {'created': '2025-10-06T04:46:31.310642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:46:31.310642', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12015484692453890592, 'uuid_mslong': 598542273711459944}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '084e7306-d7a0-4e68-a6bf-93aac1db9a20', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-4673e09b-d992-4715-bd6f-487b8371bdbc', 'type': 'virtual_router', 'uuid': '084e7306-d7a0-4e68-a6bf-93aac1db9a20'} 10/06/2025 04:46:31.384 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4220-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-1'], 'id_perms': {'created': '2025-10-06T04:46:31.373653', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:46:31.373653', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9299353136858007448, 'uuid_mslong': 11734169288488536382}}, 'parent_type': 'global-system-config', 'parent_uuid': '70faf83e-8667-40be-869e-984939182a8d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a2d824cc-2ea8-493e-810d-f0686b560798', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-91adf09f-d615-4716-9bb0-3c234c3171bf', 'type': 'virtual_router', 'uuid': 'a2d824cc-2ea8-493e-810d-f0686b560798'} 10/06/2025 04:46:31.673 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-2', 'vhost0'], 'id_perms': {'created': '2025-10-06T04:46:31.648367', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:46:31.648367', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12846153241572322452, 'uuid_mslong': 2466116914367842656}}, 'parent_type': 'virtual-router', 'parent_uuid': '084e7306-d7a0-4e68-a6bf-93aac1db9a20', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22396844-7f7a-4960-b246-b44fb626ac94', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:22:39:68:44:7f']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '7854edf9-199d-4ba5-b71f-913ae732ff38'}]}, 'oper': 'CREATE', 'request-id': 'req-faf23c98-49db-4fc9-889a-ba413a4d8d26', 'type': 'virtual_machine_interface', 'uuid': '22396844-7f7a-4960-b246-b44fb626ac94'} 10/06/2025 04:46:31.718 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-faf23c98-49db-4fc9-889a-ba413a4d8d26', 'type': 'virtual_machine_interface', 'uuid': '22396844-7f7a-4960-b246-b44fb626ac94'} 10/06/2025 04:46:31.768 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-1', 'vhost0'], 'id_perms': {'created': '2025-10-06T04:46:31.746411', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-06T04:46:31.746411', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13536113242184032436, 'uuid_mslong': 3494075771315177573}}, 'parent_type': 'virtual-router', 'parent_uuid': 'a2d824cc-2ea8-493e-810d-f0686b560798', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '307d7366-cf8a-4865-bbd9-ef46bfd720b4', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:30:7d:73:66:cf']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '7854edf9-199d-4ba5-b71f-913ae732ff38'}]}, 'oper': 'CREATE', 'request-id': 'req-30d57464-42ae-490e-8ba8-65fb1aad3761', 'type': 'virtual_machine_interface', 'uuid': '307d7366-cf8a-4865-bbd9-ef46bfd720b4'} 10/06/2025 04:46:31.819 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4220-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-30d57464-42ae-490e-8ba8-65fb1aad3761', 'type': 'virtual_machine_interface', 'uuid': '307d7366-cf8a-4865-bbd9-ef46bfd720b4'} 10/06/2025 04:46:32.214 7f6c421dc438 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-45330fbc-14ab-4976-a23f-d66ab1a9f32d', 'type': 'access_control_list', 'uuid': '572a8663-a932-43c5-bc1f-6d0da4475677'} 10/06/2025 04:46:44.927 7f6c423e3e10 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/06/2025 04:47:21.829 7f6c422e1c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/06/2025 04:48:37.061 7f6c421dcf60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map