10/16/2025 05:23:40.449 7fb465f3f648 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/16/2025 05:23:40.449 7fb465f3f648 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/16/2025 05:23:40.449 7fb465f3f648 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/16/2025 05:23:40.449 7fb45d640048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 10/16/2025 05:23:40.450 7fb45d640048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/16/2025 05:23:40.450 7fb45d640048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/16/2025 05:23:40.450 7fb45d640048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/16/2025 05:23:40.450 7fb45d640048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.451 7fb45d640048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/16/2025 05:23:40.451 7fb45d640048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.451 7fb45d640048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.451 7fb45d640048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1760592220450533 collector_name = collector_ip = collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 10/16/2025 05:23:40.451 7fb45d640048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.512 7fb465f3f648 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//', 'pyamqp://guest:guest@10.0.0.242:5673//'] 10/16/2025 05:23:40.521 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/16/2025 05:23:40.521 7fb45d5b52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.521 7fb45d5b52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:23:40.522 7fb45d5b52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.522 7fb45d5b52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.522 7fb45d5b52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:23:40.522 7fb45d5b52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.526 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/16/2025 05:23:40.526 7fb45d5b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.526 7fb45d5b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/16/2025 05:23:40.527 7fb45d5b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.557 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/16/2025 05:23:40.558 7fb45d5b44e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.558 7fb45d5b44e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:23:40.558 7fb45d5b44e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.562 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/16/2025 05:23:40.563 7fb46be40978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.563 7fb46be40978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/16/2025 05:23:40.563 7fb46be40978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.577 7fb465f3f648 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 10/16/2025 05:23:40.578 7fb465f3f648 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/16/2025 05:23:40.578 7fb465f3f648 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/16/2025 05:23:40.578 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/16/2025 05:23:40.579 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 10/16/2025 05:23:40.579 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/16/2025 05:23:40.580 7fb45d5b5ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 10/16/2025 05:23:40.580 7fb45d5b5ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 10/16/2025 05:23:40.580 7fb45d551048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.580 7fb45d551048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:40.580 7fb45d551048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.583 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/16/2025 05:23:40.585 7fb462ec66d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/16/2025 05:23:40.586 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 10/16/2025 05:23:40.586 7fb45d5b5ac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 10/16/2025 05:23:40.611 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/16/2025 05:23:40.613 7fb45d3d9198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.613 7fb45d3d9198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/16/2025 05:23:40.613 7fb45d3d9198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.620 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/16/2025 05:23:40.620 7fb45d360b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:40.621 7fb45d360b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:40.621 7fb45d360b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:41.626 7fb465f3f648 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created 10/16/2025 05:23:41.634 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/16/2025 05:23:41.676 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/16/2025 05:23:42.126 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:43.065 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created 10/16/2025 05:23:43.073 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:44.450 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:23:44.452 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:44.453 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:44.453 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:44.453 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:44.453 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:23:44.453 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:44.938 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:45.835 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:23:45.842 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:46.825 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:47.290 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created 10/16/2025 05:23:47.298 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:48.453 7fb45d32a4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:23:48.454 7fb45d32a4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:23:48.454 7fb45d32a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:48.455 7fb45d32a4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:23:48.456 7fb45d32a4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:49.234 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:50.156 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:23:50.160 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:52.126 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:52.128 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 10/16/2025 05:23:52.132 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:52.455 7fb462c1d048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:52.456 7fb462c1d048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:23:52.457 7fb462c1d048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:54.239 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:23:55.161 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:23:55.166 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:23:55.167 7fb462f0f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.167 7fb462f0f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:23:55.167 7fb462f0f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.189 7fb465f3f648 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 10/16/2025 05:23:55.190 7fb45d32cf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.190 7fb45d32cf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 10/16/2025 05:23:55.191 7fb45d32cf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.203 7fb45d3d9390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.203 7fb45d3d9390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:23:55.204 7fb45d3d9390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:55.204 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 10/16/2025 05:23:55.204 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 10/16/2025 05:23:55.205 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/16/2025 05:23:55.205 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4340-2. 10/16/2025 05:23:55.209 7fb462ec66d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/16/2025 05:23:55.337 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4340-2.'] 10/16/2025 05:23:55.366 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/16/2025 05:23:55.371 7fb462ec66d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/16/2025 05:23:55.422 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4340-2.'] 10/16/2025 05:23:55.718 7fb465f3f648 [contrail-device-manager] [DEBUG]: Fetching all containers 10/16/2025 05:23:55.768 7fb465f3f648 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 10/16/2025 05:23:55.943 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..config_queue 10/16/2025 05:23:55.943 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..tftp_queue 10/16/2025 05:23:56.444 7fb465f3f648 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode... 10/16/2025 05:23:56.444 7fb465f3f648 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 10/16/2025 05:23:56.444 7fb465f3f648 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 10/16/2025 05:23:56.449 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 10/16/2025 05:23:56.449 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 10/16/2025 05:23:56.450 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 10/16/2025 05:23:56.451 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 10/16/2025 05:23:56.452 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 10/16/2025 05:23:56.452 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 10/16/2025 05:23:56.456 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 10/16/2025 05:23:56.457 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 10/16/2025 05:23:56.458 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 10/16/2025 05:23:56.458 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 10/16/2025 05:23:56.459 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 10/16/2025 05:23:56.459 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 10/16/2025 05:23:56.459 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 10/16/2025 05:23:56.459 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 10/16/2025 05:23:56.459 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 10/16/2025 05:23:56.460 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 10/16/2025 05:23:56.461 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 10/16/2025 05:23:56.462 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 10/16/2025 05:23:56.463 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 10/16/2025 05:23:56.463 7fb465f3f648 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 10/16/2025 05:23:56.466 7fb465f3f648 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 10/16/2025 05:23:56.483 7fb45ca45048 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 10/16/2025 05:23:56.483 7fb45ca45048 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 10/16/2025 05:23:56.548 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.548 7fb45c23ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:23:56.548 7fb45c23ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.549 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/16/2025 05:23:56.550 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:23:56.554 7fb45c23ac18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:23:56.554 7fb45c23ac18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:23:56.554 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:23:56.555 7fb45c23ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.556 7fb45c23ac18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.556 7fb45c23ac18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:23:56.556 7fb45c23ac18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.566 7fb462ec66d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/16/2025 05:23:56.568 7fb45c124cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.569 7fb45c124cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:23:56.569 7fb45c124cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:23:56.767 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4340-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 10/16/2025 05:23:56.794 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 10/16/2025 05:23:56.799 7fb462ec66d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 10/16/2025 05:23:56.882 7fb462ec66d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-4340-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-4340-2..tftp_queue', 'device_manager_ztp.ztp_queue'] 10/16/2025 05:24:00.555 7fb45ca10048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:00.557 7fb45ca10048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:00.558 7fb45ca10048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:00.559 7fb45ca10048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:02.723 7fb45c0c6f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:02.723 7fb45c0c6f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:02.723 7fb45c0c6f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:04.557 7fb45c04d780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:04.559 7fb45c04d780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:04.559 7fb45c04d780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:04.560 7fb45c04d780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:04.560 7fb45c04d780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:04.560 7fb45c04d780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:04.560 7fb45c04d780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:04.561 7fb45c04d780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:04.561 7fb45c04d780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:04.561 7fb45c04d780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:04.561 7fb45c04d780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:04.562 7fb45c04d780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:04.562 7fb45c04d780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:04.562 7fb45c04d780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:08.559 7fb45c0478d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:08.561 7fb45c0478d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:08.562 7fb45c0478d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:12.562 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:12.563 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:12.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:16.564 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:16.565 7fb45c041ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:16.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:16.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:16.567 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:16.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:20.566 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:20.567 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:20.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:24.568 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:24.570 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:24.571 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:28.571 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:28.572 7fb45c041ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:28.573 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:28.574 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:28.574 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:28.574 7fb45c041ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:28.574 7fb45c041ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:28.574 7fb45c041ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:32.574 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:32.575 7fb45c048ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:32.575 7fb45c048ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:32.575 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:32.576 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:32.576 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:32.576 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:32.576 7fb45c048ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:32.576 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:32.577 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:32.577 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:32.577 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:32.577 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:32.577 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:36.577 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:36.578 7fb45c048ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:36.579 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:36.580 7fb45c048ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:36.580 7fb45c048ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:36.580 7fb45c048ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:40.579 7fb45c08dcc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:40.580 7fb45c08dcc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:40.580 7fb45c08dcc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:40.580 7fb45c08dcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:40.580 7fb45c08dcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:40.580 7fb45c08dcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:40.581 7fb45c08dcc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:44.581 7fb45c0482e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:44.583 7fb45c0482e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:44.583 7fb45c0482e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:44.583 7fb45c0482e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:44.583 7fb45c0482e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:44.584 7fb45c0482e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:44.584 7fb45c0482e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:44.584 7fb45c0482e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:44.584 7fb45c0482e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:44.584 7fb45c0482e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:44.585 7fb45c0482e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:44.585 7fb45c0482e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:44.585 7fb45c0482e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:44.585 7fb45c0482e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:48.583 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:48.584 7fb45d343978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:48.584 7fb45d343978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:48.585 7fb45d343978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:48.586 7fb45d343978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:48.586 7fb45d343978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:52.586 7fb45c048588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:52.587 7fb45c048588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:52.587 7fb45c048588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:52.588 7fb45c048588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:52.589 7fb45c048588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:56.588 7fb4630ed438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:24:56.590 7fb4630ed438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:56.591 7fb4630ed438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:24:56.591 7fb4630ed438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:56.591 7fb4630ed438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:24:56.591 7fb4630ed438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:24:56.591 7fb4630ed438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:00.592 7fb45c0f9390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:00.593 7fb45c0f9390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:00.593 7fb45c0f9390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:00.593 7fb45c0f9390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:00.594 7fb45c0f9390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:04.594 7fb45d3d1390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:04.595 7fb45d3d1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:04.596 7fb45d3d1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:04.596 7fb45d3d1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:04.596 7fb45d3d1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:04.596 7fb45d3d1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:04.596 7fb45d3d1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:08.595 7fb45c048e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:08.597 7fb45c048e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:08.598 7fb45c048e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:08.599 7fb45c048e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:08.599 7fb45c048e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:08.599 7fb45c048e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:08.599 7fb45c048e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:12.598 7fb45c041a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:12.600 7fb45c041a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:12.601 7fb45c041a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.861 7fb465f3f648 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 10/16/2025 05:25:14.861 7fb465f3f648 [contrail-device-manager] [WARNING]: initializing cassandra cluster 10/16/2025 05:25:14.862 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 10/16/2025 05:25:14.862 7fb45cacf048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.862 7fb45cacf048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:14.862 7fb45cacf048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.863 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 10/16/2025 05:25:14.896 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 10/16/2025 05:25:14.898 7fb45c16f978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.898 7fb45c16f978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 10/16/2025 05:25:14.898 7fb45c16f978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.906 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 10/16/2025 05:25:14.907 7fb45c16f828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.907 7fb45c16f828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:14.907 7fb45c16f828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:14.924 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:16.024 7fb465f3f648 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 10/16/2025 05:25:16.028 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:16.034 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:16.601 7fb45c1996d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:16.602 7fb45c1996d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:16.603 7fb45c1996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:16.604 7fb45c1996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:16.604 7fb45c1996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:16.604 7fb45c1996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:17.100 7fb465f3f648 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 10/16/2025 05:25:17.104 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:17.104 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 10/16/2025 05:25:17.184 7fb465f3f648 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 10/16/2025 05:25:17.192 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:18.136 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 10/16/2025 05:25:18.141 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:18.148 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:19.243 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:25:19.249 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:19.254 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:20.186 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 10/16/2025 05:25:20.191 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:20.197 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:20.603 7fb457f9bd68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:20.605 7fb457f9bd68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:20.606 7fb457f9bd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:20.607 7fb457f9bd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:20.607 7fb457f9bd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:20.607 7fb457f9bd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:20.607 7fb457f9bd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:20.607 7fb457f9bd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:21.080 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:25:21.085 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:21.093 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:22.219 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 10/16/2025 05:25:22.226 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:22.235 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:23.136 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:25:23.140 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:23.146 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:24.074 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 10/16/2025 05:25:24.079 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:24.085 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 10/16/2025 05:25:24.606 7fb457fb3d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:24.607 7fb457fb3d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:24.608 7fb457fb3d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:24.609 7fb457fb3d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:24.609 7fb457fb3d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.178 7fb465f3f648 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 10/16/2025 05:25:25.185 7fb465f3f648 [contrail-device-manager] [WARNING]: Zookeeper lock released. 10/16/2025 05:25:25.186 7fb457f97780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.186 7fb457f97780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:25.186 7fb457f97780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.229 7fb465f3f648 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.241:5673//', 'pyamqp://guest:guest@10.0.0.242:5673//'] 10/16/2025 05:25:25.230 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 10/16/2025 05:25:25.230 7fb457fa90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.231 7fb457fa90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:25:25.231 7fb457fa90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.231 7fb457fa90f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.231 7fb457fa90f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:25:25.231 7fb457fa90f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.240 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 10/16/2025 05:25:25.240 7fb457fa5198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.241 7fb457fa5198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:25.241 7fb457fa5198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.279 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/16/2025 05:25:25.280 7fb457f9dd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.281 7fb457f9dd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:25:25.281 7fb457f9dd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.285 7fb465f3f648 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/16/2025 05:25:25.285 7fb457f9de10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.285 7fb457f9de10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:25.286 7fb457f9de10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.287 7fb457fa5198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 10/16/2025 05:25:25.287 7fb457ffd438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.287 7fb457ffd438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/16/2025 05:25:25.287 7fb457ffd438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.294 7fb457fa4e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.294 7fb457fa4e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:25.294 7fb457fa4e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:25.296 7fb457fa5198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 10/16/2025 05:25:28.609 7fb45e2552e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:28.610 7fb45e2552e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:28.610 7fb45e2552e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:28.610 7fb45e2552e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:28.611 7fb45e2552e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:28.716 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'id_perms': {'created': '2025-10-16T05:25:28.693845', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:25:28.693845', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9517841232672232489, 'uuid_mslong': 3669638243108188}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '000d0984-3bef-455c-8416-2a2c65fe9429'}, 'oper': 'CREATE', 'request-id': 'req-1ee7b5bb-2ca1-498e-a996-a0bff04d975d', 'type': 'database_node', 'uuid': '000d0984-3bef-455c-8416-2a2c65fe9429'} 10/16/2025 05:25:29.143 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'id_perms': {'created': '2025-10-16T05:25:29.117654', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:25:29.117654', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12601662730426509211, 'uuid_mslong': 16243561089765428610}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e16cb8bf-c2d3-4d82-aee2-197ca259e79b'}, 'oper': 'CREATE', 'request-id': 'req-009315bf-0b77-454c-8795-3d8083a563eb', 'type': 'database_node', 'uuid': 'e16cb8bf-c2d3-4d82-aee2-197ca259e79b'} 10/16/2025 05:25:29.186 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'id_perms': {'created': '2025-10-16T05:25:29.166993', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:25:29.166993', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11742068770852905747, 'uuid_mslong': 12193013844343475709}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a936497d-7583-4dfd-a2f4-3555bee52313'}, 'oper': 'CREATE', 'request-id': 'req-1e9f7167-1a1d-4b95-8a89-7492c5b32e2f', 'type': 'database_node', 'uuid': 'a936497d-7583-4dfd-a2f4-3555bee52313'} 10/16/2025 05:25:32.612 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:32.613 7fb457f9b4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:32.613 7fb457f9b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:32.613 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:32.614 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:32.615 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:36.615 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:36.616 7fb457f9b4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:36.617 7fb457f9b4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:36.618 7fb457f9b4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:40.617 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:40.618 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:40.619 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:40.619 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:40.619 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:40.619 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:40.619 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:44.619 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:44.621 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:44.622 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:48.622 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:48.624 7fb45d316d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:48.624 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:48.624 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:48.625 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:48.626 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:48.626 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:52.625 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:52.627 7fb45d316d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:52.627 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:52.627 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:52.628 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.241:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:52.629 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:52.629 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:52.629 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.241:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:52.629 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:56.628 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:25:56.629 7fb45d316d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/16/2025 05:25:56.630 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:56.631 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.242:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/16/2025 05:25:56.631 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:56.631 7fb45d316d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:56.631 7fb45d316d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 138 http_port = 8096 start_time = 1760592220450533 collector_name = collector_ip = 10.0.0.242:8086 collector_list = [ 10.0.0.242:8086, 10.0.0.38:8086, 10.0.0.241:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 10/16/2025 05:25:56.631 7fb45d316d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/16/2025 05:25:59.392 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'id_perms': {'created': '2025-10-16T05:25:59.378080', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:25:59.378080', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12260085880593012639, 'uuid_mslong': 18422894361900044027}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ffab44d0-3f99-4efb-aa24-9326d487579f'}, 'oper': 'CREATE', 'request-id': 'req-e89c4a6e-aee1-4d5d-95dc-2075f3f87358', 'type': 'analytics_node', 'uuid': 'ffab44d0-3f99-4efb-aa24-9326d487579f'} 10/16/2025 05:26:00.188 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'id_perms': {'created': '2025-10-16T05:26:00.164985', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:00.164985', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10392272385761059361, 'uuid_mslong': 4934420978065360660}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '447a95bc-61d2-4714-9038-c4ac9a63a221'}, 'oper': 'CREATE', 'request-id': 'req-bb0ea847-6c75-4f7c-9aa3-d8445ef610bb', 'type': 'analytics_node', 'uuid': '447a95bc-61d2-4714-9038-c4ac9a63a221'} 10/16/2025 05:26:00.297 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'id_perms': {'created': '2025-10-16T05:26:00.279115', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:00.279115', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11751136872523033229, 'uuid_mslong': 11634467013347265212}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a175ee1b-4990-4abc-a314-6cb9b1baea8d'}, 'oper': 'CREATE', 'request-id': 'req-ea4801e2-1d66-4c18-a55f-5ce1e02cfd2f', 'type': 'analytics_node', 'uuid': 'a175ee1b-4990-4abc-a314-6cb9b1baea8d'} 10/16/2025 05:26:00.631 7fb457f3e8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/16/2025 05:26:00.633 7fb457f3e8d0 [contrail-device-manager] [INFO]: Session Event: TCP Connected 10/16/2025 05:26:00.633 7fb457f3e8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/16/2025 05:26:00.633 7fb457f3e8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:26:00.633 7fb457f3e8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4340-2. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.241:5673, 10.0.0.242:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.241:9041, 10.0.0.242:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.241:2181, 10.0.0.242:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.38,10.0.0.241,10.0.0.242:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/16/2025 05:26:00.634 7fb457f3e8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 10/16/2025 05:26:00.635 7fb457f3e978 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/16/2025 05:26:00.636 7fb457f3e978 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/16/2025 05:26:11.717 7fb457f3eeb8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 10/16/2025 05:26:11.717 7fb457f3eeb8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/16/2025 05:26:11.718 7fb457fa9630 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 10/16/2025 05:26:11.718 7fb457fa9630 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 10/16/2025 05:26:11.718 7fb457fa9630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/16/2025 05:26:11.718 7fb457fa9630 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/16/2025 05:26:11.718 7fb457fa9630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 10/16/2025 05:26:11.719 7fb45c0f9390 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 10/16/2025 05:26:11.720 7fb45c0f9390 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 10/16/2025 05:26:16.638 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'id_perms': {'created': '2025-10-16T05:26:16.611142', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:16.611142', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12997778453193332398, 'uuid_mslong': 18199773813473362915}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fc9295db-5889-43e3-b461-62a353d096ae'}, 'oper': 'CREATE', 'request-id': 'req-710143fe-56e7-4610-9819-0ce36df4784e', 'type': 'analytics_alarm_node', 'uuid': 'fc9295db-5889-43e3-b461-62a353d096ae'} 10/16/2025 05:26:16.665 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'id_perms': {'created': '2025-10-16T05:26:16.607665', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:16.607665', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12909406889516548461, 'uuid_mslong': 5738106214422298915}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4fa1d933-421a-4123-b327-6d2b469d416d'}, 'oper': 'CREATE', 'request-id': 'req-6d3f9867-551e-49b8-8a42-10fd5fc04f9f', 'type': 'analytics_alarm_node', 'uuid': '4fa1d933-421a-4123-b327-6d2b469d416d'} 10/16/2025 05:26:16.752 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'id_perms': {'created': '2025-10-16T05:26:16.724768', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:16.724768', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11038001835636730877, 'uuid_mslong': 11992497073305830865}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a66de88c-984e-45d1-992e-dc300b3cabfd'}, 'oper': 'CREATE', 'request-id': 'req-8cdfaa28-b814-400f-8632-6a777ab65a86', 'type': 'analytics_alarm_node', 'uuid': 'a66de88c-984e-45d1-992e-dc300b3cabfd'} 10/16/2025 05:26:21.660 7fb457f3eeb8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 10/16/2025 05:26:21.661 7fb457f3eeb8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 10/16/2025 05:26:21.661 7fb45d324828 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 10/16/2025 05:26:21.662 7fb45d324828 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 10/16/2025 05:26:21.662 7fb45d324828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/16/2025 05:26:21.662 7fb45d324828 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/16/2025 05:26:26.868 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.241', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-2.'], 'id_perms': {'created': '2025-10-16T05:26:26.853638', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:26.853638', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11577880938015878612, 'uuid_mslong': 5157021481269545577}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '47916bb6-d221-4a69-a0ac-e55ef233edd4'}, 'oper': 'CREATE', 'request-id': 'req-09397bd9-c521-41a3-b011-a58ec23ef594', 'type': 'analytics_snmp_node', 'uuid': '47916bb6-d221-4a69-a0ac-e55ef233edd4'} 10/16/2025 05:26:26.906 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.242', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-3.'], 'id_perms': {'created': '2025-10-16T05:26:26.898877', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:26.898877', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10391838663276455593, 'uuid_mslong': 8945270478536983270}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c23fc1b-2cfc-42e6-9037-3a34b7c366a9'}, 'oper': 'CREATE', 'request-id': 'req-d96b53ee-5db4-44ff-8b68-ce0bdafade2a', 'type': 'analytics_snmp_node', 'uuid': '7c23fc1b-2cfc-42e6-9037-3a34b7c366a9'} 10/16/2025 05:26:26.998 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4340-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4340-1.'], 'id_perms': {'created': '2025-10-16T05:26:26.987477', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:26:26.987477', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11162886788328886326, 'uuid_mslong': 13292437564890498425}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b8783989-f65b-4579-9aea-8a63f63e9036'}, 'oper': 'CREATE', 'request-id': 'req-e7646fef-e40f-4700-9197-ad5ebd983731', 'type': 'analytics_snmp_node', 'uuid': 'b8783989-f65b-4579-9aea-8a63f63e9036'} 10/16/2025 05:28:13.015 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-c5ea6c3b-3d43-488e-89f9-9ba8736e16be', 'type': 'global_system_config', 'uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69'} 10/16/2025 05:28:13.081 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-75978b4b-7989-40ff-90c7-274d47eb47bd', 'type': 'global_system_config', 'uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69'} 10/16/2025 05:28:13.154 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4340-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-1'], 'id_perms': {'created': '2025-10-16T05:28:13.145583', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:28:13.145583', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12652482772869167066, 'uuid_mslong': 6475010623118983755}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '59dbdbdb-0be3-424b-af96-a60bd39db7da', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.5'}, 'oper': 'CREATE', 'request-id': 'req-da4ee71f-f527-4424-bb0d-d1811a7a79e2', 'type': 'virtual_router', 'uuid': '59dbdbdb-0be3-424b-af96-a60bd39db7da'} 10/16/2025 05:28:13.226 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4340-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-2'], 'id_perms': {'created': '2025-10-16T05:28:13.209028', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:28:13.209028', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12111993890291261373, 'uuid_mslong': 1007973151219400771}}, 'parent_type': 'global-system-config', 'parent_uuid': '73cb6424-a464-4ca5-8e1a-2dd52deeeb69', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0dfd0a3d-9590-4043-a816-724568831fbd', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.145'}, 'oper': 'CREATE', 'request-id': 'req-77fdca75-fef0-4867-a82b-c0b6d6e9f483', 'type': 'virtual_router', 'uuid': '0dfd0a3d-9590-4043-a816-724568831fbd'} 10/16/2025 05:28:13.523 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-1', 'vhost0'], 'id_perms': {'created': '2025-10-16T05:28:13.499528', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:28:13.499528', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12248651050047798248, 'uuid_mslong': 4222103226708476789}}, 'parent_type': 'virtual-router', 'parent_uuid': '59dbdbdb-0be3-424b-af96-a60bd39db7da', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3a97ec83-d8fd-4375-a9fb-f33bdfd07be8', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:3a:97:ec:83:d8']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ee260ce8-b673-4392-ac2d-8647dfb5f5ba'}]}, 'oper': 'CREATE', 'request-id': 'req-bf558f06-ff32-4e5f-af73-061051c7766a', 'type': 'virtual_machine_interface', 'uuid': '3a97ec83-d8fd-4375-a9fb-f33bdfd07be8'} 10/16/2025 05:28:13.570 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-bf558f06-ff32-4e5f-af73-061051c7766a', 'type': 'virtual_machine_interface', 'uuid': '3a97ec83-d8fd-4375-a9fb-f33bdfd07be8'} 10/16/2025 05:28:13.627 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-2', 'vhost0'], 'id_perms': {'created': '2025-10-16T05:28:13.601784', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-10-16T05:28:13.601784', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10813235162072091933, 'uuid_mslong': 1837144675809054101}}, 'parent_type': 'virtual-router', 'parent_uuid': '0dfd0a3d-9590-4043-a816-724568831fbd', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '197ed959-5a99-4d95-9610-5416c4120d1d', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:19:7e:d9:59:5a']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ee260ce8-b673-4392-ac2d-8647dfb5f5ba'}]}, 'oper': 'CREATE', 'request-id': 'req-ab1e4536-eb54-430d-970e-32d9604ab21c', 'type': 'virtual_machine_interface', 'uuid': '197ed959-5a99-4d95-9610-5416c4120d1d'} 10/16/2025 05:28:13.677 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4340-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-ab1e4536-eb54-430d-970e-32d9604ab21c', 'type': 'virtual_machine_interface', 'uuid': '197ed959-5a99-4d95-9610-5416c4120d1d'} 10/16/2025 05:28:14.072 7fb45d3242e8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-fb3d7e4c-42fe-400b-82a2-02b1757cb92c', 'type': 'access_control_list', 'uuid': 'bff3eff7-d0e2-421b-9f1b-dd6346bcb3cf'} 10/16/2025 05:28:28.707 7fb45c1b7f60 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/16/2025 05:29:09.118 7fb45e1de4e0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/16/2025 05:30:31.719 7fb457fb1cc0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map