08/14/2025 04:58:21.525 7fd24c6a81c8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/14/2025 04:58:21.526 7fd24c6a81c8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/14/2025 04:58:21.526 7fd24c6a81c8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/14/2025 04:58:21.526 7fd23fce52e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 08/14/2025 04:58:21.526 7fd23fce52e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/14/2025 04:58:21.526 7fd23fce52e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/14/2025 04:58:21.526 7fd23fce52e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755147501526745 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/14/2025 04:58:21.527 7fd23fce52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.579 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 08/14/2025 04:58:21.587 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 04:58:21.588 7fd23fb36588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:25.530 7fd23fb55c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:25.531 7fd23fb55c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:25.531 7fd23fb55c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:25.532 7fd23fb55c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.601 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/14/2025 04:58:27.601 7fd23fae14e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.601 7fd23fae14e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:27.601 7fd23fae14e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.611 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/14/2025 04:58:27.612 7fd23fb36438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.612 7fd23fb36438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 04:58:27.612 7fd23fb36438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.615 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/14/2025 04:58:27.615 7fd23fb55ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.615 7fd23fb55ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:27.616 7fd23fb55ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.624 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 08/14/2025 04:58:27.624 7fd24c6a81c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/14/2025 04:58:27.625 7fd24c6a81c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/14/2025 04:58:27.625 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/14/2025 04:58:27.625 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 08/14/2025 04:58:27.625 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/14/2025 04:58:27.625 7fd23fb36b70 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 08/14/2025 04:58:27.626 7fd23fb36b70 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 08/14/2025 04:58:27.626 7fd23fae1240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.626 7fd23fae1240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:27.626 7fd23fae1240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.628 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/14/2025 04:58:27.631 7fd24c670f60 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/14/2025 04:58:27.631 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 08/14/2025 04:58:27.632 7fd23fb36b70 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 08/14/2025 04:58:27.662 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/14/2025 04:58:27.663 7fd23faaf2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.664 7fd23faaf2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/14/2025 04:58:27.665 7fd23faaf2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.672 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/14/2025 04:58:27.672 7fd23faaf198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.672 7fd23faaf198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:27.673 7fd23faaf198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:27.679 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/14/2025 04:58:27.711 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/14/2025 04:58:29.534 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:29.535 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:29.536 7fd23f1cfeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:30.226 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 04:58:31.150 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 08/14/2025 04:58:31.154 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 04:58:31.693 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 04:58:32.575 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 04:58:32.581 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 04:58:33.536 7fd23f1b48d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:33.537 7fd23f1b48d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:33.537 7fd23f1b48d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:33.538 7fd23f1b48d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:34.388 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 04:58:35.148 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 08/14/2025 04:58:35.154 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 04:58:36.091 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 04:58:36.704 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 04:58:36.708 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 04:58:36.708 7fd23fab12e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.709 7fd23fab12e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:36.709 7fd23fab12e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.771 7fd24c6a81c8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 08/14/2025 04:58:36.772 7fd23f1a58d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.772 7fd23f1a58d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 08/14/2025 04:58:36.772 7fd23f1a58d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.781 7fd23f1c1c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.782 7fd23f1c1c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:36.782 7fd23f1c1c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:36.782 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 08/14/2025 04:58:36.782 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 08/14/2025 04:58:36.782 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/14/2025 04:58:36.784 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3852-1. 08/14/2025 04:58:36.787 7fd24c670f60 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/14/2025 04:58:36.809 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3852-1.'] 08/14/2025 04:58:36.815 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/14/2025 04:58:36.819 7fd24c670f60 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/14/2025 04:58:36.831 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3852-1.'] 08/14/2025 04:58:37.295 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Fetching all containers 08/14/2025 04:58:37.405 7fd24c6a81c8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 08/14/2025 04:58:37.538 7fd23f0b1198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:37.540 7fd23f0b1198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:37.541 7fd23f0b1198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:37.689 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..config_queue 08/14/2025 04:58:37.690 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..tftp_queue 08/14/2025 04:58:37.842 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/14/2025 04:58:37.862 7fd24c670f60 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/14/2025 04:58:37.881 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3852-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..tftp_queue'] 08/14/2025 04:58:38.191 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Process 136 prepared to run in Full mode... 08/14/2025 04:58:38.191 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 08/14/2025 04:58:38.191 7fd24c6a81c8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 08/14/2025 04:58:38.194 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 08/14/2025 04:58:38.194 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 08/14/2025 04:58:38.194 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 08/14/2025 04:58:38.194 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 08/14/2025 04:58:38.195 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 08/14/2025 04:58:38.195 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 08/14/2025 04:58:38.199 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 08/14/2025 04:58:38.200 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 08/14/2025 04:58:38.201 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 08/14/2025 04:58:38.202 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 08/14/2025 04:58:38.203 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 08/14/2025 04:58:38.204 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 08/14/2025 04:58:38.207 7fd24c6a81c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 08/14/2025 04:58:38.218 7fd23f07c048 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 08/14/2025 04:58:38.218 7fd23f07c048 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 08/14/2025 04:58:38.261 7fd23e8e6a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:38.261 7fd23e8e6a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/14/2025 04:58:38.261 7fd23e8e6a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:38.271 7fd23e7c7978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:38.271 7fd23e7c7978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/14/2025 04:58:38.271 7fd23e7c7978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:38.889 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/14/2025 04:58:38.893 7fd24c670f60 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/14/2025 04:58:38.906 7fd24c670f60 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3852-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3852-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 08/14/2025 04:58:41.541 7fd23e830390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:41.542 7fd23e830390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:41.543 7fd23e830390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:44.404 7fd23e655eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:44.405 7fd23e655eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:44.405 7fd23e655eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:45.543 7fd23e5ca240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:45.546 7fd23e5ca240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:45.547 7fd23e5ca240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:49.550 7fd23faa08d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:49.556 7fd23faa08d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:49.556 7fd23faa08d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:49.556 7fd23faa08d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:49.556 7fd23faa08d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:49.557 7fd23faa08d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:53.556 7fd23e7d5198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:53.557 7fd23e7d5198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:53.558 7fd23e7d5198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:53.559 7fd23e7d5198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:53.559 7fd23e7d5198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:53.559 7fd23e7d5198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:53.559 7fd23e7d5198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:57.559 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:58:57.560 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:58:57.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:01.561 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:01.562 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:01.563 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:01.564 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:05.564 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:05.565 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:05.565 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:05.565 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:05.566 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:09.567 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:09.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:09.569 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:09.569 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:09.569 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:13.568 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:13.569 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:13.570 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:13.571 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:13.571 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:13.571 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:13.571 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:17.571 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:17.571 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:17.572 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:17.573 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:17.573 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:17.573 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:17.573 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:21.573 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:21.575 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:21.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:25.575 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:25.576 7fd23fa1f048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:25.576 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:25.577 7fd23fa1f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:29.579 7fd23e5caeb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:29.585 7fd23e5caeb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:29.586 7fd23e5caeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:33.583 7fd23e5c2780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:33.583 7fd23e5c2780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:33.584 7fd23e5c2780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:33.585 7fd23e5c2780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:33.585 7fd23e5c2780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:33.585 7fd23e5c2780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:37.584 7fd23f1b96d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:37.590 7fd23f1b96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:37.591 7fd23f1b96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:37.591 7fd23f1b96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:37.591 7fd23f1b96d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:37.591 7fd23f1b96d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:37.591 7fd23f1b96d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:41.590 7fd249749c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:41.594 7fd249749c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:41.595 7fd249749c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:45.595 7fd23e5c2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:45.596 7fd23e5c2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:45.597 7fd23e5c2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:49.597 7fd23efe6f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:49.598 7fd23efe6f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:49.599 7fd23efe6f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:49.599 7fd23efe6f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:49.599 7fd23efe6f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:49.599 7fd23efe6f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:49.599 7fd23efe6f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:53.599 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:53.600 7fd23f1c1cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:53.600 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:53.600 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:53.600 7fd23f1c1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:53.601 7fd23f1c1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:57.602 7fd23e76d2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 04:59:57.605 7fd23e76d2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 04:59:57.605 7fd23e76d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 04:59:57.605 7fd23e76d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:57.605 7fd23e76d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 04:59:57.606 7fd23e76d2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.706 7fd24c6a81c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/14/2025 04:59:59.706 7fd24c6a81c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/14/2025 04:59:59.707 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/14/2025 04:59:59.707 7fd23e76d588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.707 7fd23e76d588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:59:59.707 7fd23e76d588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.708 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/14/2025 04:59:59.740 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/14/2025 04:59:59.742 7fd23e7dec18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.742 7fd23e7dec18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/14/2025 04:59:59.742 7fd23e7dec18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.750 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/14/2025 04:59:59.750 7fd23e7dea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.751 7fd23e7dea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 04:59:59.751 7fd23e7dea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 04:59:59.762 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:00.679 7fd24c6a81c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 08/14/2025 05:00:00.683 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:00.687 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:01.606 7fd23e8670f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:01.608 7fd23e8670f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 05:00:01.608 7fd23e8670f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:01.608 7fd23e8670f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:01.608 7fd23e8670f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 05:00:01.609 7fd23e8670f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:02.168 7fd24c6a81c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 08/14/2025 05:00:02.172 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:02.172 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/14/2025 05:00:02.254 7fd24c6a81c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/14/2025 05:00:02.266 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:03.190 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 08/14/2025 05:00:03.193 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:03.199 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:03.673 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 05:00:03.676 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:03.685 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:04.430 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 08/14/2025 05:00:04.434 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:04.441 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:05.608 7fd23e58e780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:05.609 7fd23e58e780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 05:00:05.609 7fd23e58e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:05.609 7fd23e58e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 05:00:05.610 7fd23e58e780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:05.713 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 05:00:05.722 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:05.727 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:06.439 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 08/14/2025 05:00:06.443 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:06.448 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:07.541 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 05:00:07.545 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:07.549 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:09.058 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 08/14/2025 05:00:09.063 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:09.069 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/14/2025 05:00:09.610 7fd23faab6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:09.611 7fd23faab6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/14/2025 05:00:09.612 7fd23faab6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:09.613 7fd23faab6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:09.613 7fd23faab6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 05:00:09.613 7fd23faab6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.148 7fd24c6a81c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 08/14/2025 05:00:10.152 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/14/2025 05:00:10.152 7fd2497caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.153 7fd2497caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:10.153 7fd2497caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.202 7fd24c6a81c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//'] 08/14/2025 05:00:10.203 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 05:00:10.203 7fd23e8aa240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.207 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/14/2025 05:00:10.207 7fd23e8aad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.208 7fd23e8aad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:10.208 7fd23e8aad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.259 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/14/2025 05:00:10.259 7fd23e8aa240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.260 7fd23e8aa240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 05:00:10.260 7fd23e8aa240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.262 7fd24c6a81c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/14/2025 05:00:10.262 7fd23e8aad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.262 7fd23e8aad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:10.262 7fd23e8aad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.263 7fd23e7d1390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/14/2025 05:00:10.263 7fd23e59f4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.264 7fd23e59f4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/14/2025 05:00:10.264 7fd23e59f4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.269 7fd23e7d1390 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/14/2025 05:00:10.269 7fd23e5a4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:10.269 7fd23e5a4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:10.269 7fd23e5a4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:13.612 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:13.613 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:13.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:13.615 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 05:00:13.615 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:17.614 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:17.615 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/14/2025 05:00:17.615 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:17.615 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755147501526745 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.254:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/14/2025 05:00:17.616 7fd23e7fb2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/14/2025 05:00:21.046 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'id_perms': {'created': '2025-08-14T05:00:21.040440', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:21.040440', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10737441028152450541, 'uuid_mslong': 10116486856536510256}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8c64fb32-52c4-4f30-9503-0db9c7bb5ded'}, 'oper': 'CREATE', 'request-id': 'req-5eff2595-7d69-4ca9-95d7-06bc1f9ac11c', 'type': 'analytics_node', 'uuid': '8c64fb32-52c4-4f30-9503-0db9c7bb5ded'} 08/14/2025 05:00:21.420 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'id_perms': {'created': '2025-08-14T05:00:21.411726', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:21.411726', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13318541239326830738, 'uuid_mslong': 11462386589761227425}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f1293df-80eb-4aa1-b8d4-f6b148777092'}, 'oper': 'CREATE', 'request-id': 'req-27524344-288a-48d0-beaa-aeace94beb8d', 'type': 'analytics_node', 'uuid': '9f1293df-80eb-4aa1-b8d4-f6b148777092'} 08/14/2025 05:00:21.465 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'id_perms': {'created': '2025-08-14T05:00:21.455246', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:21.455246', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13683179007609005863, 'uuid_mslong': 14982156696333340028}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cfeb5022-ee30-4d7c-bde4-6acf929de727'}, 'oper': 'CREATE', 'request-id': 'req-9753fba8-5814-4892-b7d8-7402ce891787', 'type': 'analytics_node', 'uuid': 'cfeb5022-ee30-4d7c-bde4-6acf929de727'} 08/14/2025 05:00:21.616 7fd23e4f3630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [INFO]: Session Event: TCP Connected 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3852-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/14/2025 05:00:21.617 7fd23e4f3630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/14/2025 05:00:21.618 7fd23e4f3630 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 08/14/2025 05:00:21.618 7fd23e4f3630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/14/2025 05:00:21.618 7fd23e4f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/14/2025 05:00:21.618 7fd23e4f3630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/14/2025 05:00:21.618 7fd23e59f588 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/14/2025 05:00:21.619 7fd23e59f588 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/14/2025 05:00:31.304 7fd23e59f780 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 08/14/2025 05:00:31.304 7fd23e59f780 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/14/2025 05:00:31.304 7fd246488ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/14/2025 05:00:31.305 7fd246488ac8 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 08/14/2025 05:00:31.305 7fd246488ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/14/2025 05:00:31.305 7fd246488ac8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/14/2025 05:00:31.305 7fd246488ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/14/2025 05:00:31.305 7fd2448a24e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/14/2025 05:00:31.306 7fd2448a24e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/14/2025 05:00:36.666 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'id_perms': {'created': '2025-08-14T05:00:36.656084', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:36.656084', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10085697728320482512, 'uuid_mslong': 1460291267008547224}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1443ff2b-9ea6-4998-8bf7-98a5c881acd0'}, 'oper': 'CREATE', 'request-id': 'req-8d011732-55f2-4407-9502-1e79e41b55d7', 'type': 'analytics_alarm_node', 'uuid': '1443ff2b-9ea6-4998-8bf7-98a5c881acd0'} 08/14/2025 05:00:37.214 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'id_perms': {'created': '2025-08-14T05:00:37.198817', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:37.198817', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13518555948275108658, 'uuid_mslong': 13834549379414900951}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bffe315c-aba0-40d7-bb9b-8f02b52e8b32'}, 'oper': 'CREATE', 'request-id': 'req-1579b236-602a-4d40-8a86-98d0aea93702', 'type': 'analytics_alarm_node', 'uuid': 'bffe315c-aba0-40d7-bb9b-8f02b52e8b32'} 08/14/2025 05:00:37.247 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'id_perms': {'created': '2025-08-14T05:00:37.239635', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:37.239635', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12566193269642778333, 'uuid_mslong': 7865542477931759114}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6d280535-d2de-460a-ae64-16333ff656dd'}, 'oper': 'CREATE', 'request-id': 'req-7826824c-3ea5-4a5b-971a-d4291d9c1817', 'type': 'analytics_alarm_node', 'uuid': '6d280535-d2de-460a-ae64-16333ff656dd'} 08/14/2025 05:00:41.777 7fd23e59f780 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 08/14/2025 05:00:41.777 7fd23e59f780 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/14/2025 05:00:41.778 7fd23f1b6630 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/14/2025 05:00:41.778 7fd23f1b6630 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 08/14/2025 05:00:41.778 7fd23f1b6630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/14/2025 05:00:41.778 7fd23f1b6630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/14/2025 05:00:46.135 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-1.'], 'id_perms': {'created': '2025-08-14T05:00:46.122363', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:46.122363', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10094936068701694855, 'uuid_mslong': 18285136565895647052}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fdc1dad3-efb7-4f4c-8c18-6ade853e2b87'}, 'oper': 'CREATE', 'request-id': 'req-890ce028-ce53-4cac-a4c6-a25ab1f2ef3d', 'type': 'analytics_snmp_node', 'uuid': 'fdc1dad3-efb7-4f4c-8c18-6ade853e2b87'} 08/14/2025 05:00:46.605 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-2.'], 'id_perms': {'created': '2025-08-14T05:00:46.594399', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:46.594399', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12527593099926174857, 'uuid_mslong': 14835663379321931682}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cde2dd3d-a3c1-47a2-adda-f38ce3bbfc89'}, 'oper': 'CREATE', 'request-id': 'req-fb0735c7-e75b-46bc-8b3c-f20492df23e3', 'type': 'analytics_snmp_node', 'uuid': 'cde2dd3d-a3c1-47a2-adda-f38ce3bbfc89'} 08/14/2025 05:00:46.633 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3852-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3852-3.'], 'id_perms': {'created': '2025-08-14T05:00:46.626161', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:00:46.626161', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11657600842841951666, 'uuid_mslong': 9340023562711944928}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '819e6df1-d939-4ee0-a1c8-1e33b2e38db2'}, 'oper': 'CREATE', 'request-id': 'req-5e4b1781-37b8-4503-aca8-5bab04117aa8', 'type': 'analytics_snmp_node', 'uuid': '819e6df1-d939-4ee0-a1c8-1e33b2e38db2'} 08/14/2025 05:02:26.284 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-75a96609-8877-4b8b-82d1-5a03dc3c9cb3', 'type': 'global_system_config', 'uuid': '18ccd446-fc84-42d3-888b-468865ea121b'} 08/14/2025 05:02:26.329 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-d1f52a18-886a-49a3-9721-4faa6d37aa29', 'type': 'global_system_config', 'uuid': '18ccd446-fc84-42d3-888b-468865ea121b'} 08/14/2025 05:02:26.425 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3852-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-1'], 'id_perms': {'created': '2025-08-14T05:02:26.414340', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:02:26.414340', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9473672251808999198, 'uuid_mslong': 7030484461449988039}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '61914c5e-5ba1-47c7-8379-3eb8278ce71e', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-d1ee938f-5918-4a46-ac84-8607fc01c079', 'type': 'virtual_router', 'uuid': '61914c5e-5ba1-47c7-8379-3eb8278ce71e'} 08/14/2025 05:02:26.495 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3852-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-2'], 'id_perms': {'created': '2025-08-14T05:02:26.486466', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:02:26.486466', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11857248047404319734, 'uuid_mslong': 6720425705610758692}}, 'parent_type': 'global-system-config', 'parent_uuid': '18ccd446-fc84-42d3-888b-468865ea121b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5d43bf92-aa55-4a24-a48d-6846d73a83f6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-2b7a31cf-8932-4917-a03e-e045d3e8219a', 'type': 'virtual_router', 'uuid': '5d43bf92-aa55-4a24-a48d-6846d73a83f6'} 08/14/2025 05:02:26.826 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-1', 'vhost0'], 'id_perms': {'created': '2025-08-14T05:02:26.776973', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:02:26.776973', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12905606072463537955, 'uuid_mslong': 12951499431318996495}}, 'parent_type': 'virtual-router', 'parent_uuid': '61914c5e-5ba1-47c7-8379-3eb8278ce71e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b3bcf81c-e071-460f-b319-ec5898503723', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:b3:bc:f8:1c:e0']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '31b81b90-194a-4227-a2df-8385ce1662de'}]}, 'oper': 'CREATE', 'request-id': 'req-8e3a2f2e-3981-4837-ba19-6fb76761de4f', 'type': 'virtual_machine_interface', 'uuid': 'b3bcf81c-e071-460f-b319-ec5898503723'} 08/14/2025 05:02:26.886 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-8e3a2f2e-3981-4837-ba19-6fb76761de4f', 'type': 'virtual_machine_interface', 'uuid': 'b3bcf81c-e071-460f-b319-ec5898503723'} 08/14/2025 05:02:26.937 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-2', 'vhost0'], 'id_perms': {'created': '2025-08-14T05:02:26.878633', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-14T05:02:26.878633', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12997732532045802228, 'uuid_mslong': 1618863419739753540}}, 'parent_type': 'virtual-router', 'parent_uuid': '5d43bf92-aa55-4a24-a48d-6846d73a83f6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '16775bb4-0176-4c44-b461-38df7a20eaf4', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:16:77:5b:b4:01']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '31b81b90-194a-4227-a2df-8385ce1662de'}]}, 'oper': 'CREATE', 'request-id': 'req-fc6d588d-e431-44c7-a00b-0b8243cd0abf', 'type': 'virtual_machine_interface', 'uuid': '16775bb4-0176-4c44-b461-38df7a20eaf4'} 08/14/2025 05:02:26.988 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3852-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-fc6d588d-e431-44c7-a00b-0b8243cd0abf', 'type': 'virtual_machine_interface', 'uuid': '16775bb4-0176-4c44-b461-38df7a20eaf4'} 08/14/2025 05:02:27.371 7fd23e7f3ac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-7aa0de7a-c443-434c-be7f-911b032e370e', 'type': 'access_control_list', 'uuid': 'bcaef6cb-8ce0-4eb1-bc67-59efe88e7d0c'} 08/14/2025 05:02:48.174 7fd23e597c18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/14/2025 05:03:20.136 7fd23e861630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/14/2025 05:04:44.622 7fd23e867828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map