06/09/2025 00:49:39.816 7fb331857ec8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 06/09/2025 00:49:39.817 7fb331857ec8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 06/09/2025 00:49:39.817 7fb331857ec8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 06/09/2025 00:49:39.817 7fb328e942e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 06/09/2025 00:49:39.817 7fb328e942e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.818 7fb328e942e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.819 7fb328e942e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 start_time = 1749430179818261 collector_name = collector_ip = collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 06/09/2025 00:49:39.819 7fb328e942e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.869 7fb331857ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//'] 06/09/2025 00:49:39.880 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 06/09/2025 00:49:39.880 7fb328ded588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.880 7fb328ded588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:49:39.880 7fb328ded588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.880 7fb328ded588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.880 7fb328ded588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:49:39.881 7fb328ded588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.884 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 06/09/2025 00:49:39.885 7fb328ded588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.885 7fb328ded588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/09/2025 00:49:39.885 7fb328ded588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.918 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/09/2025 00:49:39.919 7fb328ded240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.919 7fb328ded240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:49:39.920 7fb328ded240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.923 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/09/2025 00:49:39.923 7fb337699978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:39.924 7fb337699978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 06/09/2025 00:49:39.924 7fb337699978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.272 7fb331857ec8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 06/09/2025 00:49:40.273 7fb331857ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 06/09/2025 00:49:40.273 7fb331857ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 06/09/2025 00:49:40.273 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 06/09/2025 00:49:40.274 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 06/09/2025 00:49:40.274 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/09/2025 00:49:40.274 7fb32b635978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 06/09/2025 00:49:40.274 7fb32b635978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 06/09/2025 00:49:40.275 7fb328c81588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.275 7fb328c81588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:40.275 7fb328c81588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.277 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 06/09/2025 00:49:40.279 7fb328e0a438 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/09/2025 00:49:40.279 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 06/09/2025 00:49:40.279 7fb32b635978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 06/09/2025 00:49:40.323 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 06/09/2025 00:49:40.324 7fb328c13978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.324 7fb328c13978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 06/09/2025 00:49:40.324 7fb328c13978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.331 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 06/09/2025 00:49:40.331 7fb328c14e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:40.332 7fb328c14e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:40.332 7fb328c14e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:41.343 7fb331857ec8 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 06/09/2025 00:49:41.352 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 06/09/2025 00:49:41.372 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 06/09/2025 00:49:41.981 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:42.566 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 06/09/2025 00:49:42.572 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:43.818 7fb328b5ab70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:49:43.819 7fb328b5ab70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:43.820 7fb328b5ab70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:43.821 7fb328b5ab70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:49:43.821 7fb328b5ab70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:44.944 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:45.637 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:49:45.642 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:47.525 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:47.820 7fb328b87630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:49:47.821 7fb328b87630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:49:47.821 7fb328b87630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:49:47.821 7fb328b87630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:47.821 7fb328b87630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:49:47.822 7fb328b87630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:48.269 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 06/09/2025 00:49:48.273 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:50.315 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:50.606 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:49:50.611 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:51.822 7fb328b6ef60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:49:51.823 7fb328b6ef60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:49:51.823 7fb328b6ef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:49:51.823 7fb328b6ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:51.824 7fb328b6ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:49:51.825 7fb328b6ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:52.302 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:52.304 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 06/09/2025 00:49:52.307 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:54.015 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:49:55.343 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:49:55.348 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:49:55.348 7fb328c13ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.349 7fb328c13ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:49:55.349 7fb328c13ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.366 7fb331857ec8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 06/09/2025 00:49:55.369 7fb3282fe828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.371 7fb3282fe828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 06/09/2025 00:49:55.371 7fb3282fe828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.382 7fb32830b6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.382 7fb32830b6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:49:55.382 7fb32830b6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.383 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 06/09/2025 00:49:55.383 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 06/09/2025 00:49:55.383 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/09/2025 00:49:55.383 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3418-3. 06/09/2025 00:49:55.390 7fb328e0a438 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/09/2025 00:49:55.518 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3418-3.'] 06/09/2025 00:49:55.536 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/09/2025 00:49:55.540 7fb328e0a438 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/09/2025 00:49:55.588 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3418-3.'] 06/09/2025 00:49:55.824 7fb328b67eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:55.826 7fb328b67eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:49:55.827 7fb328b67eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:55.894 7fb331857ec8 [contrail-device-manager] [DEBUG]: Fetching all containers 06/09/2025 00:49:55.940 7fb331857ec8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 06/09/2025 00:49:56.108 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..config_queue 06/09/2025 00:49:56.109 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..tftp_queue 06/09/2025 00:49:56.609 7fb331857ec8 [contrail-device-manager] [WARNING]: Process 139 prepared to run in Full mode... 06/09/2025 00:49:56.610 7fb331857ec8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 06/09/2025 00:49:56.610 7fb331857ec8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 06/09/2025 00:49:56.613 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 06/09/2025 00:49:56.613 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 06/09/2025 00:49:56.614 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 06/09/2025 00:49:56.614 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 06/09/2025 00:49:56.615 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 06/09/2025 00:49:56.615 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 06/09/2025 00:49:56.619 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 06/09/2025 00:49:56.619 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 06/09/2025 00:49:56.619 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 06/09/2025 00:49:56.620 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 06/09/2025 00:49:56.622 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 06/09/2025 00:49:56.623 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 06/09/2025 00:49:56.624 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 06/09/2025 00:49:56.625 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 06/09/2025 00:49:56.625 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 06/09/2025 00:49:56.625 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 06/09/2025 00:49:56.625 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 06/09/2025 00:49:56.625 7fb331857ec8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 06/09/2025 00:49:56.627 7fb331857ec8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 06/09/2025 00:49:56.640 7fb3282858d0 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 06/09/2025 00:49:56.640 7fb3282858d0 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 06/09/2025 00:49:56.687 7fb323a89c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:56.688 7fb323a89c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/09/2025 00:49:56.688 7fb323a89c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:56.688 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/09/2025 00:49:56.702 7fb328e0a438 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/09/2025 00:49:56.704 7fb323975a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:56.704 7fb323975a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/09/2025 00:49:56.704 7fb323975a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:56.934 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3418-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 06/09/2025 00:49:56.960 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 06/09/2025 00:49:56.968 7fb328e0a438 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 06/09/2025 00:49:57.041 7fb328e0a438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3418-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3418-3..tftp_queue', 'device_manager_ztp.ztp_queue'] 06/09/2025 00:49:59.827 7fb3238a8438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:49:59.828 7fb3238a8438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:49:59.828 7fb3238a8438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:49:59.828 7fb3238a8438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:59.829 7fb3238a8438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/09/2025 00:49:59.829 7fb3238a8438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:49:59.829 7fb3238a8438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:49:59.829 7fb3238a8438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:49:59.829 7fb3238a8438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:59.830 7fb3238a8438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 06/09/2025 00:49:59.830 7fb3238a8438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:59.830 7fb3238a8438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:49:59.830 7fb3238a8438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:49:59.830 7fb3238a8438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:02.864 7fb32391a390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:02.864 7fb32391a390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:02.864 7fb32391a390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:03.829 7fb32389d828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:03.831 7fb32389d828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:03.832 7fb32389d828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:07.832 7fb323842b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:07.833 7fb323842b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:07.833 7fb323842b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:07.833 7fb323842b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:07.834 7fb323842b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:11.835 7fb32c656ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:11.836 7fb32c656ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:11.836 7fb32c656ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:11.836 7fb32c656ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:11.837 7fb32c656ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:15.837 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:15.838 7fb323897978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:15.838 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:15.838 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:15.839 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:15.840 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:19.840 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:19.842 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:19.843 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:23.843 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:23.844 7fb323897978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:23.844 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:23.844 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:23.844 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:23.845 7fb323897978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:27.844 7fb32389ef60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:27.846 7fb32389ef60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:27.846 7fb32389ef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:27.846 7fb32389ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:27.847 7fb32389ef60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:31.847 7fb3238f0630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:31.848 7fb3238f0630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:31.849 7fb3238f0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:31.850 7fb3238f0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:31.850 7fb3238f0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:31.850 7fb3238f0630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:31.850 7fb3238f0630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:31.850 7fb3238f0630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:35.849 7fb3335ce240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:35.851 7fb3335ce240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:35.852 7fb3335ce240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:39.852 7fb3238f0588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:39.853 7fb3238f0588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:39.853 7fb3238f0588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:39.854 7fb3238f0588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:39.854 7fb3238f0588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:39.854 7fb3238f0588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:39.854 7fb3238f0588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:39.855 7fb3238f0588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:43.854 7fb3375f3630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:43.855 7fb3375f3630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:43.856 7fb3375f3630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:47.856 7fb32e908240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:47.857 7fb32e908240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:47.858 7fb32e908240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:51.857 7fb323931b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:51.859 7fb323931b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:51.859 7fb323931b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:51.859 7fb323931b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:51.859 7fb323931b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:51.859 7fb323931b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:51.860 7fb323931b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:51.861 7fb323931b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:51.861 7fb323931b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:55.860 7fb323931ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:55.862 7fb323931ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:55.863 7fb323931ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:59.863 7fb323895828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:50:59.864 7fb323895828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:50:59.865 7fb323895828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.580 7fb331857ec8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 06/09/2025 00:51:00.580 7fb331857ec8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 06/09/2025 00:51:00.580 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 06/09/2025 00:51:00.581 7fb32e890240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.581 7fb32e890240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:00.581 7fb32e890240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.582 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 06/09/2025 00:51:00.613 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 06/09/2025 00:51:00.617 7fb323859a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.618 7fb323859a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 06/09/2025 00:51:00.618 7fb323859a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.625 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 06/09/2025 00:51:00.626 7fb3238598d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.626 7fb3238598d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:00.626 7fb3238598d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:00.638 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:01.329 7fb331857ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 06/09/2025 00:51:01.334 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:01.340 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:02.005 7fb331857ec8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 06/09/2025 00:51:02.010 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:02.010 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 06/09/2025 00:51:02.094 7fb331857ec8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 06/09/2025 00:51:02.102 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:03.647 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 06/09/2025 00:51:03.652 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:03.663 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:03.864 7fb32376e0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:03.866 7fb32376e0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:03.867 7fb32376e0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:03.867 7fb32376e0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:03.867 7fb32376e0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:03.867 7fb32376e0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:04.349 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:51:04.354 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:04.362 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:05.085 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 06/09/2025 00:51:05.090 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:05.097 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:05.703 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:51:05.709 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:05.716 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:06.441 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 06/09/2025 00:51:06.447 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:06.453 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:07.339 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:51:07.344 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:07.351 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:07.866 7fb3237ef240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:07.867 7fb3237ef240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:07.868 7fb3237ef240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:07.868 7fb3237ef240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:07.868 7fb3237ef240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:07.868 7fb3237ef240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:07.868 7fb3237ef240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:07.869 7fb3237ef240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:07.869 7fb3237ef240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:07.869 7fb3237ef240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 06/09/2025 00:51:07.869 7fb3237ef240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:07.869 7fb3237ef240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:07.870 7fb3237ef240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:07.870 7fb3237ef240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.278 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 06/09/2025 00:51:08.282 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:08.288 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 06/09/2025 00:51:08.695 7fb331857ec8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 06/09/2025 00:51:08.699 7fb331857ec8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 06/09/2025 00:51:08.700 7fb32e959a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.700 7fb32e959a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:08.700 7fb32e959a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.767 7fb331857ec8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.249:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//', 'pyamqp://guest:guest@10.0.0.41:5673//'] 06/09/2025 00:51:08.768 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 06/09/2025 00:51:08.768 7fb32c656eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.769 7fb32c656eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:51:08.769 7fb32c656eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.769 7fb32c656eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.769 7fb32c656eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:51:08.769 7fb32c656eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.772 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 06/09/2025 00:51:08.773 7fb3239dcac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.773 7fb3239dcac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:08.773 7fb3239dcac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.800 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/09/2025 00:51:08.800 7fb3237f9ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.801 7fb3237f9ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:51:08.801 7fb3237f9ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.804 7fb331857ec8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/09/2025 00:51:08.804 7fb3239dcc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.804 7fb3239dcc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:08.804 7fb3239dcc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.805 7fb32e959a20 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 06/09/2025 00:51:08.805 7fb3237c4048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.805 7fb3237c4048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 06/09/2025 00:51:08.806 7fb3237c4048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.810 7fb32e959a20 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 06/09/2025 00:51:08.810 7fb323768cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:08.810 7fb323768cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:08.810 7fb323768cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:11.868 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:11.869 7fb328b56240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:11.870 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:11.871 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:11.871 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:11.871 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:11.871 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:11.871 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:15.871 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:15.872 7fb328b56240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:15.872 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:15.872 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:15.873 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:19.874 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:19.875 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:19.876 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:23.875 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:23.876 7fb328b56240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:23.876 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:23.876 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:23.877 7fb328b56240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:24.597 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'id_perms': {'created': '2025-06-09T00:51:24.562165', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:24.562165', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10527487033923488749, 'uuid_mslong': 15214332958896113334}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd3242b37-9585-46b6-9219-25ae2a8a4bed'}, 'oper': 'CREATE', 'request-id': 'req-ec153b8f-e943-4bb9-82df-3ddea73eb183', 'type': 'database_node', 'uuid': 'd3242b37-9585-46b6-9219-25ae2a8a4bed'} 06/09/2025 00:51:25.452 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'id_perms': {'created': '2025-06-09T00:51:25.438249', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:25.438249', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10403249221710596323, 'uuid_mslong': 1026790925444727794}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0e3fe4e8-11ba-43f2-905f-c40c61eb48e3'}, 'oper': 'CREATE', 'request-id': 'req-e456f302-3900-4926-96a4-473acb88c492', 'type': 'database_node', 'uuid': '0e3fe4e8-11ba-43f2-905f-c40c61eb48e3'} 06/09/2025 00:51:25.468 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'id_perms': {'created': '2025-06-09T00:51:25.448246', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:25.448246', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12013080051328774870, 'uuid_mslong': 6265101203456608140}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '56f21c59-c1e7-478c-a6b7-08a89dc872d6'}, 'oper': 'CREATE', 'request-id': 'req-b5f4afd7-1a20-4f0a-bf19-e61c8088254b', 'type': 'database_node', 'uuid': '56f21c59-c1e7-478c-a6b7-08a89dc872d6'} 06/09/2025 00:51:27.878 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:27.879 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:27.880 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:31.880 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:31.881 7fb3237886d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:31.881 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:31.881 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:31.881 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:31.882 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:31.882 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:31.883 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:31.883 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:31.883 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:31.883 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:31.883 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:31.884 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:31.884 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:35.882 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:35.883 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:35.884 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:39.884 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:39.885 7fb3237886d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:39.885 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:39.885 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:39.886 7fb3237886d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:43.886 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:43.887 7fb3282fe978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:43.888 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:43.889 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.249:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:43.889 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:47.889 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:47.889 7fb3282fe978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.41:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:47.890 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:47.891 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:47.891 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.41:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:47.891 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:51.891 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:51.893 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.19:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 139 http_port = 8096 start_time = 1749430179818261 collector_name = collector_ip = 10.0.0.19:8086 collector_list = [ 10.0.0.249:8086, 10.0.0.41:8086, 10.0.0.19:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 06/09/2025 00:51:51.894 7fb3282fe978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 06/09/2025 00:51:55.093 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'id_perms': {'created': '2025-06-09T00:51:55.083901', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:55.083901', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12566268039685228572, 'uuid_mslong': 15838751897876251707}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dbce8cef-0e75-443b-ae64-5a3401c8481c'}, 'oper': 'CREATE', 'request-id': 'req-c65cb71f-03c4-48c5-ade6-83a55bb42de0', 'type': 'analytics_node', 'uuid': 'dbce8cef-0e75-443b-ae64-5a3401c8481c'} 06/09/2025 00:51:55.186 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'id_perms': {'created': '2025-06-09T00:51:55.178236', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:55.178236', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10421078535167418028, 'uuid_mslong': 17940512454861080120}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f8f98106-5877-4638-909f-1bb6e91a1eac'}, 'oper': 'CREATE', 'request-id': 'req-4f0680b1-95ea-439a-b0d6-eae66365d0fe', 'type': 'analytics_node', 'uuid': 'f8f98106-5877-4638-909f-1bb6e91a1eac'} 06/09/2025 00:51:55.203 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'id_perms': {'created': '2025-06-09T00:51:55.197243', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:51:55.197243', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10116484979957653518, 'uuid_mslong': 1693333990398248181}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '177fee4a-e7c8-44f5-8c64-f97d65f3600e'}, 'oper': 'CREATE', 'request-id': 'req-657f8dac-c85a-45dc-b9b3-1235d42b0291', 'type': 'analytics_node', 'uuid': '177fee4a-e7c8-44f5-8c64-f97d65f3600e'} 06/09/2025 00:51:55.894 7fb32377a828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [INFO]: Session Event: TCP Connected 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3418-3. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.249:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.249:5673, 10.0.0.19:5673, 10.0.0.41:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.249:9041, 10.0.0.19:9041, 10.0.0.41:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.249:2181, 10.0.0.19:2181, 10.0.0.41:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.249,10.0.0.19,10.0.0.41:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 06/09/2025 00:51:55.895 7fb32377a828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 06/09/2025 00:51:55.896 7fb32377a828 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 06/09/2025 00:51:55.896 7fb32377a828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 06/09/2025 00:51:55.896 7fb32377a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/09/2025 00:51:55.896 7fb32377a828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 06/09/2025 00:51:55.896 7fb323785b70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/09/2025 00:51:55.897 7fb323785b70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/09/2025 00:52:04.591 7fb3237c3630 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 06/09/2025 00:52:04.592 7fb3237c3630 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/09/2025 00:52:04.592 7fb323842390 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 06/09/2025 00:52:04.592 7fb323842390 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 06/09/2025 00:52:04.593 7fb323842390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/09/2025 00:52:04.593 7fb323842390 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/09/2025 00:52:04.593 7fb323842390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 06/09/2025 00:52:04.593 7fb323785c18 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 06/09/2025 00:52:04.594 7fb323785c18 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 06/09/2025 00:52:11.996 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'id_perms': {'created': '2025-06-09T00:52:11.968732', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:11.968732', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9921168385558825813, 'uuid_mslong': 16881555426537458680}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ea475537-d6d5-4bf8-89af-12150211cb55'}, 'oper': 'CREATE', 'request-id': 'req-4141ba9c-2615-4508-995c-2a81195c0ba9', 'type': 'analytics_alarm_node', 'uuid': 'ea475537-d6d5-4bf8-89af-12150211cb55'} 06/09/2025 00:52:12.105 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'id_perms': {'created': '2025-06-09T00:52:12.079612', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:12.079612', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11255792658849937467, 'uuid_mslong': 8459447219819921612}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7565fe6d-2588-40cc-9c34-9bc99833383b'}, 'oper': 'CREATE', 'request-id': 'req-9f0929d5-d731-448d-8465-5fa01bc7e79d', 'type': 'analytics_alarm_node', 'uuid': '7565fe6d-2588-40cc-9c34-9bc99833383b'} 06/09/2025 00:52:12.254 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'id_perms': {'created': '2025-06-09T00:52:12.245834', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:12.245834', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11476379584678143490, 'uuid_mslong': 7644382374746210672}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a164d44-a601-4170-9f44-4a6d84492602'}, 'oper': 'CREATE', 'request-id': 'req-b9ef9789-95eb-4fbe-9199-583b4381fbd9', 'type': 'analytics_alarm_node', 'uuid': '6a164d44-a601-4170-9f44-4a6d84492602'} 06/09/2025 00:52:14.586 7fb3237c3630 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 06/09/2025 00:52:14.587 7fb3237c3630 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 06/09/2025 00:52:14.587 7fb3237c36d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 06/09/2025 00:52:14.587 7fb3237c36d8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 06/09/2025 00:52:14.587 7fb3237c36d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/09/2025 00:52:14.588 7fb3237c36d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 06/09/2025 00:52:22.081 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.19', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-2.'], 'id_perms': {'created': '2025-06-09T00:52:22.070208', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:22.070208', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13071881241530479737, 'uuid_mslong': 10449473926235571495}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9103fd2c-16fa-4527-b568-a6bb3b843479'}, 'oper': 'CREATE', 'request-id': 'req-753009cf-e39e-4576-a3bb-12f42e1a4e02', 'type': 'analytics_snmp_node', 'uuid': '9103fd2c-16fa-4527-b568-a6bb3b843479'} 06/09/2025 00:52:22.113 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-3.'], 'id_perms': {'created': '2025-06-09T00:52:22.071173', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:22.071173', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12447102612857493757, 'uuid_mslong': 14456869088364479668}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c8a11dd7-104a-44b4-acbc-fde0fa3518fd'}, 'oper': 'CREATE', 'request-id': 'req-e8565bb9-8796-434a-a6e1-dafc9e9713f1', 'type': 'analytics_snmp_node', 'uuid': 'c8a11dd7-104a-44b4-acbc-fde0fa3518fd'} 06/09/2025 00:52:22.131 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.249', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3418-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3418-1.'], 'id_perms': {'created': '2025-06-09T00:52:22.077498', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:52:22.077498', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10829542031207987652, 'uuid_mslong': 458325582522762075}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '065c4cb0-61be-435b-964a-43199a5079c4'}, 'oper': 'CREATE', 'request-id': 'req-5f2fe6f8-091d-4d5f-a3f3-9179df1d618f', 'type': 'analytics_snmp_node', 'uuid': '065c4cb0-61be-435b-964a-43199a5079c4'} 06/09/2025 00:54:04.808 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-8c1cb542-1c7f-4767-9add-8c877ecb2c9c', 'type': 'global_system_config', 'uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61'} 06/09/2025 00:54:04.891 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-508c394c-b72c-4366-a2cb-743b39bb8dd9', 'type': 'global_system_config', 'uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61'} 06/09/2025 00:54:04.948 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3418-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-2'], 'id_perms': {'created': '2025-06-09T00:54:04.934555', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:54:04.934555', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10018213566721103558, 'uuid_mslong': 12872408820656324866}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b2a3fb9f-16d3-4102-8b07-d829006916c6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-5f0236c2-8630-4d15-896f-23a21b480ee0', 'type': 'virtual_router', 'uuid': 'b2a3fb9f-16d3-4102-8b07-d829006916c6'} 06/09/2025 00:54:05.008 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3418-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-1'], 'id_perms': {'created': '2025-06-09T00:54:04.987744', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:54:04.987744', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13819045454640839019, 'uuid_mslong': 3223368118482650477}}, 'parent_type': 'global-system-config', 'parent_uuid': 'c9ab378d-78da-4b75-bf49-1d813965ec61', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2cbbb439-c27a-456d-bfc7-1c9fe2d7f96b', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-1da8f81a-de1b-4750-9cb6-9630e53514da', 'type': 'virtual_router', 'uuid': '2cbbb439-c27a-456d-bfc7-1c9fe2d7f96b'} 06/09/2025 00:54:05.354 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-2', 'vhost0'], 'id_perms': {'created': '2025-06-09T00:54:05.324410', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:54:05.324410', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11660979077866067890, 'uuid_mslong': 1275749851772175878}}, 'parent_type': 'virtual-router', 'parent_uuid': 'b2a3fb9f-16d3-4102-8b07-d829006916c6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '11b45fbb-2123-4606-a1d4-1eb0557817b2', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:11:b4:5f:bb:21']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '58694798-50ab-4860-9a08-952c924f1f97'}]}, 'oper': 'CREATE', 'request-id': 'req-6de7e2cc-5447-42e8-aed5-31a618d1ab18', 'type': 'virtual_machine_interface', 'uuid': '11b45fbb-2123-4606-a1d4-1eb0557817b2'} 06/09/2025 00:54:05.408 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-1', 'vhost0'], 'id_perms': {'created': '2025-06-09T00:54:05.378559', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-06-09T00:54:05.378559', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13793319413509398910, 'uuid_mslong': 5118856723745490774}}, 'parent_type': 'virtual-router', 'parent_uuid': '2cbbb439-c27a-456d-bfc7-1c9fe2d7f96b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4709d511-c2f8-4756-bf6b-b6ed2bba217e', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:47:09:d5:11:c2']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '58694798-50ab-4860-9a08-952c924f1f97'}]}, 'oper': 'CREATE', 'request-id': 'req-74a8cfb4-416f-4b53-826c-5cc94cc687d0', 'type': 'virtual_machine_interface', 'uuid': '4709d511-c2f8-4756-bf6b-b6ed2bba217e'} 06/09/2025 00:54:05.421 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-6de7e2cc-5447-42e8-aed5-31a618d1ab18', 'type': 'virtual_machine_interface', 'uuid': '11b45fbb-2123-4606-a1d4-1eb0557817b2'} 06/09/2025 00:54:05.482 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3418-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-74a8cfb4-416f-4b53-826c-5cc94cc687d0', 'type': 'virtual_machine_interface', 'uuid': '4709d511-c2f8-4756-bf6b-b6ed2bba217e'} 06/09/2025 00:54:05.911 7fb328cb6630 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-6be42448-7331-45f2-a4a9-2fab006c872c', 'type': 'access_control_list', 'uuid': '305b77ed-85ca-49b7-a22b-10a1adf0ecaf'} 06/09/2025 00:54:59.724 7fb3238f0978 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/09/2025 00:55:11.795 7fb3238f0630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 06/09/2025 01:43:31.222 7fb32377a828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map