07/21/2025 00:47:19.918 7fd40a617788 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 07/21/2025 00:47:19.919 7fd40a617788 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 07/21/2025 00:47:19.919 7fd40a617788 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 07/21/2025 00:47:19.919 7fd401d032e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 07/21/2025 00:47:19.919 7fd401d032e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.920 7fd401d032e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.921 7fd401d032e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1753058839920209 collector_name = collector_ip = collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 07/21/2025 00:47:19.921 7fd401d032e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.981 7fd40a617788 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//', 'pyamqp://guest:guest@10.0.0.65:5673//'] 07/21/2025 00:47:19.994 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:47:19.995 7fd401c55588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.999 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/21/2025 00:47:19.999 7fd401c55240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:19.999 7fd401c55240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/21/2025 00:47:20.000 7fd401c55240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.013 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/21/2025 00:47:20.014 7fd401c550f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.014 7fd401c550f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:47:20.014 7fd401c550f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.024 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/21/2025 00:47:20.025 7fd410508978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.025 7fd410508978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 07/21/2025 00:47:20.025 7fd410508978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.039 7fd40a617788 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 07/21/2025 00:47:20.039 7fd40a617788 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/21/2025 00:47:20.040 7fd40a617788 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/21/2025 00:47:20.040 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/21/2025 00:47:20.040 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 07/21/2025 00:47:20.040 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/21/2025 00:47:20.041 7fd4044a2978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 07/21/2025 00:47:20.041 7fd4044a2978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 07/21/2025 00:47:20.041 7fd401aec588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.041 7fd401aec588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:20.041 7fd401aec588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.044 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/21/2025 00:47:20.046 7fd4044a2978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 07/21/2025 00:47:20.046 7fd40758e6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/21/2025 00:47:20.046 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 07/21/2025 00:47:20.115 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/21/2025 00:47:20.116 7fd401a4dd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.116 7fd401a4dd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/21/2025 00:47:20.116 7fd401a4dd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.127 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/21/2025 00:47:20.127 7fd401a42f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.128 7fd401a42f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:20.128 7fd401a42f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:20.137 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/21/2025 00:47:20.186 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/21/2025 00:47:20.966 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:21.978 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 07/21/2025 00:47:21.986 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:23.920 7fd4019ec0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:23.921 7fd4019ec0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:23.922 7fd4019ec0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:24.123 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:25.897 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:47:25.904 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:27.777 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:27.921 7fd401a42828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:27.923 7fd401a42828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:27.924 7fd401a42828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:27.924 7fd401a42828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:27.924 7fd401a42828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:27.925 7fd401a42828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:27.925 7fd401a42828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:27.925 7fd401a42828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:27.925 7fd401a42828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:28.393 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 07/21/2025 00:47:28.397 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:30.113 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:31.004 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:47:31.010 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:31.924 7fd4028b5a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:31.925 7fd4028b5a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:31.925 7fd4028b5a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:31.925 7fd4028b5a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:31.925 7fd4028b5a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:31.926 7fd4028b5a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:32.301 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:32.306 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 07/21/2025 00:47:32.310 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:34.025 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:47:35.147 7fd40a617788 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:47:35.153 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:47:35.154 7fd401167978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.154 7fd401167978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:35.154 7fd401167978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.171 7fd40a617788 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 07/21/2025 00:47:35.172 7fd4019e2eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.172 7fd4019e2eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 07/21/2025 00:47:35.172 7fd4019e2eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.181 7fd4019e28d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.181 7fd4019e28d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:35.181 7fd4019e28d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.181 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 07/21/2025 00:47:35.182 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 07/21/2025 00:47:35.182 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/21/2025 00:47:35.185 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3672-1. 07/21/2025 00:47:35.192 7fd40758e6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/21/2025 00:47:35.297 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3672-1.'] 07/21/2025 00:47:35.340 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/21/2025 00:47:35.348 7fd40758e6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/21/2025 00:47:35.438 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3672-1.'] 07/21/2025 00:47:35.703 7fd40a617788 [contrail-device-manager] [DEBUG]: Fetching all containers 07/21/2025 00:47:35.834 7fd40a617788 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 07/21/2025 00:47:35.926 7fd4010d76d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:35.927 7fd4010d76d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.928 7fd4010d76d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:35.929 7fd4010d76d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:35.929 7fd4010d76d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:36.120 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..config_queue 07/21/2025 00:47:36.121 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..tftp_queue 07/21/2025 00:47:36.475 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/21/2025 00:47:36.487 7fd40758e6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/21/2025 00:47:36.622 7fd40a617788 [contrail-device-manager] [WARNING]: Process 136 prepared to run in Full mode... 07/21/2025 00:47:36.622 7fd40a617788 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 07/21/2025 00:47:36.622 7fd40a617788 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 07/21/2025 00:47:36.625 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 07/21/2025 00:47:36.625 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 07/21/2025 00:47:36.626 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 07/21/2025 00:47:36.626 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 07/21/2025 00:47:36.627 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 07/21/2025 00:47:36.627 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 07/21/2025 00:47:36.630 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 07/21/2025 00:47:36.630 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 07/21/2025 00:47:36.631 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 07/21/2025 00:47:36.632 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 07/21/2025 00:47:36.633 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 07/21/2025 00:47:36.638 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 07/21/2025 00:47:36.639 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 07/21/2025 00:47:36.639 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 07/21/2025 00:47:36.639 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 07/21/2025 00:47:36.639 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 07/21/2025 00:47:36.640 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 07/21/2025 00:47:36.641 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 07/21/2025 00:47:36.642 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 07/21/2025 00:47:36.642 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 07/21/2025 00:47:36.642 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 07/21/2025 00:47:36.642 7fd40a617788 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 07/21/2025 00:47:36.645 7fd40a617788 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 07/21/2025 00:47:36.651 7fd40108fd68 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 07/21/2025 00:47:36.651 7fd40108fd68 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 07/21/2025 00:47:36.712 7fd4008ffeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:36.712 7fd4008ffeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/21/2025 00:47:36.712 7fd4008ffeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:36.731 7fd4007f4198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:36.731 7fd4007f4198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/21/2025 00:47:36.732 7fd4007f4198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:36.763 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3672-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/21/2025 00:47:36.781 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 07/21/2025 00:47:36.786 7fd40758e6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 07/21/2025 00:47:36.844 7fd40758e6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3672-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3672-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 07/21/2025 00:47:39.928 7fd400719438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:39.929 7fd400719438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:39.929 7fd400719438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:39.930 7fd400719438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:39.931 7fd400719438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:39.931 7fd400719438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:42.871 7fd40067bf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:42.872 7fd40067bf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:42.872 7fd40067bf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:43.930 7fd4005f64e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:43.932 7fd4005f64e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:43.933 7fd4005f64e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:43.933 7fd4005f64e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:43.933 7fd4005f64e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:43.933 7fd4005f64e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:43.933 7fd4005f64e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:43.934 7fd4005f64e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:47.933 7fd4005f3a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:47.934 7fd4005f3a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:47.934 7fd4005f3a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:47.934 7fd4005f3a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:47.935 7fd4005f3a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:47.935 7fd4005f3a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:47.935 7fd4005f3a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:47.935 7fd4005f3a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:47.935 7fd4005f3a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:47.936 7fd4005f3a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:47.936 7fd4005f3a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:47.936 7fd4005f3a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:47.936 7fd4005f3a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:47.936 7fd4005f3a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:51.935 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:51.936 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:51.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:55.936 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:55.937 7fd4005f3f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:55.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:55.937 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:55.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:59.938 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:47:59.939 7fd4005f3f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:59.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:47:59.941 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:47:59.941 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:03.940 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:03.941 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:03.942 7fd4005f3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:07.942 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:07.946 7fd40078fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:07.946 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:07.946 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:07.946 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:07.947 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:07.947 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:07.947 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:07.947 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:07.947 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:07.948 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:07.948 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:07.948 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:07.948 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:11.946 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:11.947 7fd40078fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:11.947 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:11.947 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:11.947 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:11.947 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:11.948 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:11.949 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:15.947 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:15.949 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:15.950 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:15.950 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:15.950 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:15.950 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:15.950 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:19.949 7fd401a4df60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:19.951 7fd401a4df60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:19.952 7fd401a4df60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:23.951 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:23.953 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:23.954 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:23.954 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:23.954 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:23.954 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:23.954 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:27.953 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:27.954 7fd4011674e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:27.954 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:27.955 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:31.955 7fd4077d8828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:31.957 7fd4077d8828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:31.958 7fd4077d8828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:31.958 7fd4077d8828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:31.958 7fd4077d8828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:31.958 7fd4077d8828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:35.958 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:35.959 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:35.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:39.960 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:39.961 7fd4010a0cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:39.962 7fd4010a0cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:43.962 7fd40078f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:43.968 7fd40078f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:43.969 7fd40078f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:47.970 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:47.973 7fd40078fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:47.974 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:47.974 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:47.977 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:47.977 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:47.977 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:47.977 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:47.977 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:47.978 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:47.978 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:47.978 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:47.978 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:47.978 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:51.973 7fd40078fc18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:51.974 7fd40078fc18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:51.974 7fd40078fc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:51.974 7fd40078fc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:51.974 7fd40078fc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:51.975 7fd40078fc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:55.975 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:55.976 7fd4011674e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:55.977 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:55.977 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:55.977 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:48:55.977 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:48:55.977 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:48:55.978 7fd4011674e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:48:59.979 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:48:59.998 7fd40078fb70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:48:59.998 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:48:59.998 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:00.001 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:00.001 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:00.001 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:00.002 7fd40078fb70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:00.002 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:00.002 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:00.002 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:00.002 7fd40078fb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:00.011 7fd40078fb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:00.011 7fd40078fb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.118 7fd40a617788 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 07/21/2025 00:49:01.118 7fd40a617788 [contrail-device-manager] [WARNING]: initializing cassandra cluster 07/21/2025 00:49:01.119 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 07/21/2025 00:49:01.119 7fd40062b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.119 7fd40062b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:01.120 7fd40062b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.122 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 07/21/2025 00:49:01.198 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 07/21/2025 00:49:01.200 7fd4008406d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.200 7fd4008406d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 07/21/2025 00:49:01.200 7fd4008406d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.211 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 07/21/2025 00:49:01.211 7fd4008404e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.212 7fd4008404e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:01.212 7fd4008404e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:01.235 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:02.002 7fd40a617788 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 07/21/2025 00:49:02.012 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:02.031 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:03.034 7fd40a617788 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 07/21/2025 00:49:03.038 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:03.038 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 07/21/2025 00:49:03.111 7fd40a617788 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 07/21/2025 00:49:03.118 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:03.999 7fd400783cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:04.000 7fd400783cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:04.000 7fd400783cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:04.001 7fd400783cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:04.001 7fd400783cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:04.001 7fd400783cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:04.001 7fd400783cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:04.001 7fd400783cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:04.002 7fd400783cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:04.002 7fd400783cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:04.003 7fd400783cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:04.003 7fd400783cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:04.003 7fd400783cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:04.003 7fd400783cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:04.126 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 07/21/2025 00:49:04.131 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:04.139 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:04.846 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:49:04.851 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:04.862 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:05.801 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 07/21/2025 00:49:05.808 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:05.825 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:06.114 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:49:06.118 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:06.126 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:07.111 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 07/21/2025 00:49:07.119 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:07.126 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:07.809 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:49:07.818 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:07.827 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:08.001 7fd400783ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:08.002 7fd400783ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:08.003 7fd400783ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:08.408 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 07/21/2025 00:49:08.420 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:08.434 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 07/21/2025 00:49:09.149 7fd40a617788 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 07/21/2025 00:49:09.164 7fd40a617788 [contrail-device-manager] [WARNING]: Zookeeper lock released. 07/21/2025 00:49:09.164 7fd400840828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.164 7fd400840828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:09.164 7fd400840828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.215 7fd40a617788 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//', 'pyamqp://guest:guest@10.0.0.65:5673//'] 07/21/2025 00:49:09.215 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 07/21/2025 00:49:09.216 7fd40076bc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.216 7fd40076bc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:49:09.216 7fd40076bc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.216 7fd40076bc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.216 7fd40076bc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:49:09.217 7fd40076bc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.225 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 07/21/2025 00:49:09.225 7fd40076bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.225 7fd40076bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:09.225 7fd40076bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.282 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/21/2025 00:49:09.283 7fd40076bac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.283 7fd40076bac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:49:09.283 7fd40076bac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.292 7fd40a617788 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/21/2025 00:49:09.293 7fd40076b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.293 7fd40076b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:09.293 7fd40076b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.294 7fd400802e10 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 07/21/2025 00:49:09.295 7fd40076f048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.296 7fd40076f048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 07/21/2025 00:49:09.296 7fd40076f048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.316 7fd400802e10 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 07/21/2025 00:49:09.316 7fd40086f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:09.316 7fd40086f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:09.316 7fd40086f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:12.002 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:12.004 7fd400771cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:12.004 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:12.004 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:12.004 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:12.004 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:12.005 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:12.005 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:12.005 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:12.005 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:12.006 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:12.006 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:12.006 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:12.006 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:16.004 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:16.005 7fd400771cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:16.005 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:16.005 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:16.005 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:16.005 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:16.006 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:20.006 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:20.011 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:20.012 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:24.011 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:24.012 7fd400771cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.65:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:24.013 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:24.014 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:24.014 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.65:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:24.014 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:28.013 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:28.014 7fd400771cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 07/21/2025 00:49:28.015 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:28.015 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:28.015 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:28.015 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:28.015 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 07/21/2025 00:49:28.016 7fd400771cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 07/21/2025 00:49:28.016 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:28.016 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 07/21/2025 00:49:28.017 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:28.017 7fd400771cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:28.017 7fd400771cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1753058839920209 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.65:8086, 10.0.0.23:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 07/21/2025 00:49:28.017 7fd400771cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 07/21/2025 00:49:31.189 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'id_perms': {'created': '2025-07-21T00:49:31.180509', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:31.180509', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13274672499780901015, 'uuid_mslong': 2701738171526824089}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '257e808d-75f8-4099-b839-1c4e6b165897'}, 'oper': 'CREATE', 'request-id': 'req-209b83a6-3327-4f2e-9052-73aeae1892dc', 'type': 'analytics_node', 'uuid': '257e808d-75f8-4099-b839-1c4e6b165897'} 07/21/2025 00:49:31.229 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.65', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'id_perms': {'created': '2025-07-21T00:49:31.213500', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:31.213500', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11678798795507661731, 'uuid_mslong': 17586468859592262995}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f40fb040-2d77-4553-a213-6da0a97e7ba3'}, 'oper': 'CREATE', 'request-id': 'req-4574cc8c-9519-4a22-bd63-13fb2a15f742', 'type': 'analytics_node', 'uuid': 'f40fb040-2d77-4553-a213-6da0a97e7ba3'} 07/21/2025 00:49:31.308 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'id_perms': {'created': '2025-07-21T00:49:31.289884', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:31.289884', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11801812534859221936, 'uuid_mslong': 5008253232562850810}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4580e3c7-b81c-4bfa-a3c8-75f8c6094bb0'}, 'oper': 'CREATE', 'request-id': 'req-313a3a86-8b23-46bf-ab8a-adef543a18e1', 'type': 'analytics_node', 'uuid': '4580e3c7-b81c-4bfa-a3c8-75f8c6094bb0'} 07/21/2025 00:49:32.015 7fd40075af60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 07/21/2025 00:49:32.016 7fd40075af60 [contrail-device-manager] [INFO]: Session Event: TCP Connected 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3672-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.241:5673, 10.0.0.65:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.241:9041, 10.0.0.65:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.241:2181, 10.0.0.65:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.23,10.0.0.241,10.0.0.65:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 07/21/2025 00:49:32.017 7fd40075af60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 07/21/2025 00:49:32.018 7fd40075af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/21/2025 00:49:32.018 7fd40075af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 07/21/2025 00:49:32.019 7fd4005cba20 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/21/2025 00:49:32.020 7fd4005cba20 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/21/2025 00:49:41.997 7fd4005cbc18 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 07/21/2025 00:49:41.997 7fd4005cbc18 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/21/2025 00:49:41.998 7fd401a3ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 07/21/2025 00:49:41.998 7fd401a3ac18 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 07/21/2025 00:49:41.998 7fd401a3ac18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/21/2025 00:49:41.998 7fd401a3ac18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/21/2025 00:49:41.998 7fd401a3ac18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 07/21/2025 00:49:41.999 7fd40075af60 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 07/21/2025 00:49:42.000 7fd40075af60 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 07/21/2025 00:49:47.501 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'id_perms': {'created': '2025-07-21T00:49:47.487844', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:47.487844', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12671559781345908282, 'uuid_mslong': 2337117781603534544}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '206f1c3d-62ba-46d0-afda-6c7bfd3fd63a'}, 'oper': 'CREATE', 'request-id': 'req-b52dcca6-19d8-4efb-953e-5339fcdcf769', 'type': 'analytics_alarm_node', 'uuid': '206f1c3d-62ba-46d0-afda-6c7bfd3fd63a'} 07/21/2025 00:49:47.572 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'id_perms': {'created': '2025-07-21T00:49:47.558454', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:47.558454', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11501186672229761272, 'uuid_mslong': 10079484263954075589}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8be18588-e01f-4fc5-9f9c-6c57adb640f8'}, 'oper': 'CREATE', 'request-id': 'req-a6f9fbbb-3e15-4372-a4b8-007e6cd0e245', 'type': 'analytics_alarm_node', 'uuid': '8be18588-e01f-4fc5-9f9c-6c57adb640f8'} 07/21/2025 00:49:48.076 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.65', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'id_perms': {'created': '2025-07-21T00:49:48.062708', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:48.062708', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10778402368712988773, 'uuid_mslong': 12004532977406789384}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a698ab23-e4cb-4708-9594-93d9115dd865'}, 'oper': 'CREATE', 'request-id': 'req-d876206a-9438-4bd6-bec5-4231975f0e54', 'type': 'analytics_alarm_node', 'uuid': 'a698ab23-e4cb-4708-9594-93d9115dd865'} 07/21/2025 00:49:51.983 7fd4005cbc18 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 07/21/2025 00:49:51.983 7fd4005cbc18 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 07/21/2025 00:49:51.984 7fd4005eb828 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 07/21/2025 00:49:51.984 7fd4005eb828 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 07/21/2025 00:49:51.984 7fd4005eb828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/21/2025 00:49:51.984 7fd4005eb828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 07/21/2025 00:49:58.542 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.65', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-3.'], 'id_perms': {'created': '2025-07-21T00:49:58.534279', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:58.534279', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13032722452115968832, 'uuid_mslong': 4793721132662804280}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4286b7f8-d0a6-4f38-b4dd-880516a15340'}, 'oper': 'CREATE', 'request-id': 'req-624dcb11-c5b4-4acd-bebe-83e53df5df6c', 'type': 'analytics_snmp_node', 'uuid': '4286b7f8-d0a6-4f38-b4dd-880516a15340'} 07/21/2025 00:49:58.572 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-2.'], 'id_perms': {'created': '2025-07-21T00:49:58.566692', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:58.566692', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10305490047814694546, 'uuid_mslong': 17068455093547323362}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ecdf5579-9b98-4fe2-8f04-749900517692'}, 'oper': 'CREATE', 'request-id': 'req-21e9141d-99a2-4258-869b-9c0a2532790b', 'type': 'analytics_snmp_node', 'uuid': 'ecdf5579-9b98-4fe2-8f04-749900517692'} 07/21/2025 00:49:58.686 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3672-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3672-1.'], 'id_perms': {'created': '2025-07-21T00:49:58.679471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:49:58.679471', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12088707466428725139, 'uuid_mslong': 18163254091774577525}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fc10d75d-0962-4b75-a7c3-b7645a18b793'}, 'oper': 'CREATE', 'request-id': 'req-3d762587-468b-4495-89a4-b44cad594f64', 'type': 'analytics_snmp_node', 'uuid': 'fc10d75d-0962-4b75-a7c3-b7645a18b793'} 07/21/2025 00:51:41.976 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-448de8db-a14d-4530-b453-32ad61df715e', 'type': 'global_system_config', 'uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77'} 07/21/2025 00:51:42.031 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-979bc8f5-083c-42fa-a31f-8fd135be8508', 'type': 'global_system_config', 'uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77'} 07/21/2025 00:51:42.123 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3672-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-1'], 'id_perms': {'created': '2025-07-21T00:51:42.103550', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:51:42.103550', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11844543196148084349, 'uuid_mslong': 4347075659545202370}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3c53ea47-d2f0-4ec2-a460-4548252d2e7d', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-440bac67-a208-4ee3-9b83-16d76c2ebbf5', 'type': 'virtual_router', 'uuid': '3c53ea47-d2f0-4ec2-a460-4548252d2e7d'} 07/21/2025 00:51:42.153 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3672-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-2'], 'id_perms': {'created': '2025-07-21T00:51:42.138465', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:51:42.138465', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11999385373491756816, 'uuid_mslong': 3464605285917412105}}, 'parent_type': 'global-system-config', 'parent_uuid': '6272e747-41c2-4129-802c-c1e1b7fa9d77', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3014c026-ba0c-4b09-a686-616bf5fe7f10', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-4166c4f0-d633-4e5b-8b10-a533396aa144', 'type': 'virtual_router', 'uuid': '3014c026-ba0c-4b09-a686-616bf5fe7f10'} 07/21/2025 00:51:42.462 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-1', 'vhost0'], 'id_perms': {'created': '2025-07-21T00:51:42.446273', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:51:42.446273', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13407544783071058300, 'uuid_mslong': 13592392001828703029}}, 'parent_type': 'virtual-router', 'parent_uuid': '3c53ea47-d2f0-4ec2-a460-4548252d2e7d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bca1e082-94dc-4b35-ba11-2af1a917997c', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:bc:a1:e0:82:94']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'f6c8b26c-fd72-453a-ad49-84802e25d48a'}]}, 'oper': 'CREATE', 'request-id': 'req-07dd821c-8876-4415-94fa-2f000801c8af', 'type': 'virtual_machine_interface', 'uuid': 'bca1e082-94dc-4b35-ba11-2af1a917997c'} 07/21/2025 00:51:42.503 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-07dd821c-8876-4415-94fa-2f000801c8af', 'type': 'virtual_machine_interface', 'uuid': 'bca1e082-94dc-4b35-ba11-2af1a917997c'} 07/21/2025 00:51:42.540 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-2', 'vhost0'], 'id_perms': {'created': '2025-07-21T00:51:42.498737', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-07-21T00:51:42.498737', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10906754517491416000, 'uuid_mslong': 10063575386602161554}}, 'parent_type': 'virtual-router', 'parent_uuid': '3014c026-ba0c-4b09-a686-616bf5fe7f10', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8ba9007e-b8c9-4592-975c-93727b767bc0', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:8b:a9:00:7e:b8']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'f6c8b26c-fd72-453a-ad49-84802e25d48a'}]}, 'oper': 'CREATE', 'request-id': 'req-4985dd3a-e291-478a-8c0b-8571767bc04b', 'type': 'virtual_machine_interface', 'uuid': '8ba9007e-b8c9-4592-975c-93727b767bc0'} 07/21/2025 00:51:42.592 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3672-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-4985dd3a-e291-478a-8c0b-8571767bc04b', 'type': 'virtual_machine_interface', 'uuid': '8ba9007e-b8c9-4592-975c-93727b767bc0'} 07/21/2025 00:51:42.996 7fd400714eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-d8782f05-9096-42c7-9050-fe1d1c58af48', 'type': 'access_control_list', 'uuid': '850d662d-4e6f-4ce1-9021-079eee4af24b'} 07/21/2025 00:52:03.930 7fd40776fc18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/21/2025 00:52:36.790 7fd401d79240 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 07/21/2025 01:52:40.571 7fd40075ac18 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map