08/18/2025 05:02:58.010 7f66ef6ca5c8 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 08/18/2025 05:02:58.010 7f66ef6ca5c8 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 08/18/2025 05:02:58.011 7f66ef6ca5c8 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 08/18/2025 05:02:58.011 7f66e6db52e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 08/18/2025 05:02:58.012 7f66e6db52e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 08/18/2025 05:02:58.013 7f66e6db52e8 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/18/2025 05:02:58.013 7f66e6db52e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 08/18/2025 05:02:58.013 7f66e6db52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.014 7f66e6db52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 08/18/2025 05:02:58.014 7f66e6db52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.014 7f66e6db52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.014 7f66e6db52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755493378013105 collector_name = collector_ip = collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 08/18/2025 05:02:58.014 7f66e6db52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.091 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 08/18/2025 05:02:58.104 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:02:58.105 7f66e6c06588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:02.013 7f66e6c32c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:02.014 7f66e6c32c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:02.014 7f66e6c32c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:02.014 7f66e6c32c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:02.014 7f66e6c32c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:02.015 7f66e6c32c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:06.015 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:06.016 7f66e6bad2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:06.016 7f66e6bad2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:06.017 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.018 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:10.021 7f66e6bad2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:10.022 7f66e6bad2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:10.022 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:10.022 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:10.022 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:10.022 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:10.023 7f66e6bad2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.132 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/18/2025 05:03:10.133 7f66e6bbdeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.133 7f66e6bbdeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:10.133 7f66e6bbdeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.161 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/18/2025 05:03:10.162 7f66e6db58d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.162 7f66e6db58d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:03:10.162 7f66e6db58d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.166 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/18/2025 05:03:10.166 7f66e6c32630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.166 7f66e6c32630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:10.166 7f66e6c32630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.177 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 08/18/2025 05:03:10.177 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/18/2025 05:03:10.178 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/18/2025 05:03:10.178 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/18/2025 05:03:10.178 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 08/18/2025 05:03:10.178 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/18/2025 05:03:10.179 7f66e6c32438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 08/18/2025 05:03:10.179 7f66e6c32438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 08/18/2025 05:03:10.179 7f66e6bad0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.179 7f66e6bad0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:03:10.179 7f66e6bad0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.181 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/18/2025 05:03:10.190 7f66ef754a20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/18/2025 05:03:10.190 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 08/18/2025 05:03:10.191 7f66e6c32438 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 08/18/2025 05:03:10.246 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/18/2025 05:03:10.250 7f66e6b7e2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.251 7f66e6b7e2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/18/2025 05:03:10.251 7f66e6b7e2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.264 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/18/2025 05:03:10.264 7f66e6b7e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.264 7f66e6b7e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:03:10.264 7f66e6b7e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:10.275 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/18/2025 05:03:10.324 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/18/2025 05:03:11.937 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:03:12.507 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created 08/18/2025 05:03:12.513 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:03:13.567 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:03:14.024 7f66e6abaa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:14.025 7f66e6abaa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:14.026 7f66e6abaa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.140 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 08/18/2025 05:03:14.145 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:03:14.146 7f66e6a934e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.146 7f66e6a934e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:14.146 7f66e6a934e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.170 7f66ef6ca5c8 [contrail-device-manager] [ERROR]: Error in db walk read 'type' 08/18/2025 05:03:14.171 7f66e6aa5978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.171 7f66e6aa5978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down >>, ] >> 08/18/2025 05:03:14.171 7f66e6aa5978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.181 7f66e6aae198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.182 7f66e6aae198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:14.182 7f66e6aae198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:14.182 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 08/18/2025 05:03:14.183 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 08/18/2025 05:03:14.183 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/18/2025 05:03:14.184 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3874-1. 08/18/2025 05:03:14.186 7f66ef754a20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/18/2025 05:03:14.197 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3874-1.'] 08/18/2025 05:03:14.212 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/18/2025 05:03:14.217 7f66ef754a20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/18/2025 05:03:14.229 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3874-1.'] 08/18/2025 05:03:14.700 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Fetching all containers 08/18/2025 05:03:14.860 7f66ef6ca5c8 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 08/18/2025 05:03:15.076 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..config_queue 08/18/2025 05:03:15.077 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..tftp_queue 08/18/2025 05:03:15.242 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/18/2025 05:03:15.248 7f66ef754a20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/18/2025 05:03:15.391 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3874-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..tftp_queue'] 08/18/2025 05:03:15.578 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Process 136 prepared to run in Full mode... 08/18/2025 05:03:15.578 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 08/18/2025 05:03:15.578 7f66ef6ca5c8 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 08/18/2025 05:03:15.581 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 08/18/2025 05:03:15.581 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 08/18/2025 05:03:15.582 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 08/18/2025 05:03:15.582 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 08/18/2025 05:03:15.583 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 08/18/2025 05:03:15.583 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 08/18/2025 05:03:15.586 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 08/18/2025 05:03:15.586 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 08/18/2025 05:03:15.587 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 08/18/2025 05:03:15.589 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 08/18/2025 05:03:15.589 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 08/18/2025 05:03:15.589 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 08/18/2025 05:03:15.589 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 08/18/2025 05:03:15.591 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 08/18/2025 05:03:15.591 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 08/18/2025 05:03:15.591 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 08/18/2025 05:03:15.591 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 08/18/2025 05:03:15.591 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 08/18/2025 05:03:15.592 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 08/18/2025 05:03:15.592 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 08/18/2025 05:03:15.592 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 08/18/2025 05:03:15.592 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 08/18/2025 05:03:15.592 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 08/18/2025 05:03:15.593 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 08/18/2025 05:03:15.594 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 08/18/2025 05:03:15.594 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 08/18/2025 05:03:15.596 7f66ef6ca5c8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 08/18/2025 05:03:15.610 7f66e6136978 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 08/18/2025 05:03:15.610 7f66e6136978 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 08/18/2025 05:03:15.661 7f66e59afd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:15.661 7f66e59afd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Initializing description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/18/2025 05:03:15.662 7f66e59afd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:15.678 7f66e5899cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:15.679 7f66e5899cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/18/2025 05:03:15.679 7f66e5899cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:16.416 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 08/18/2025 05:03:16.421 7f66ef754a20 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 08/18/2025 05:03:16.477 7f66ef754a20 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3874-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3874-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 08/18/2025 05:03:18.026 7f66e589ea20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:18.027 7f66e589ea20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:18.028 7f66e589ea20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:18.028 7f66e589ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:18.028 7f66e589ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/18/2025 05:03:18.028 7f66e589ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:18.028 7f66e589ea20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Down description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down >>, ] >> 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:18.029 7f66e589ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:21.813 7f66e5720cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:21.813 7f66e5720cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:21.813 7f66e5720cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:22.028 7f66e56e1390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:22.030 7f66e56e1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:22.031 7f66e56e1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:22.031 7f66e56e1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:22.031 7f66e56e1390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:22.031 7f66e56e1390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:22.031 7f66e56e1390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:26.030 7f66e6abc4e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:26.034 7f66e6abc4e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:26.034 7f66e6abc4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:26.034 7f66e6abc4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:26.034 7f66e6abc4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:26.035 7f66e6abc4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:30.035 7f66e56e7780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:30.036 7f66e56e7780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:30.036 7f66e56e7780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:30.036 7f66e56e7780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:30.036 7f66e56e7780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:30.036 7f66e56e7780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:30.037 7f66e56e7780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:34.037 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:34.038 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:34.039 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:38.039 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:38.040 7f66e56e4630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:38.041 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:38.042 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:38.042 7f66e56e4630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:38.042 7f66e56e4630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:38.042 7f66e56e4630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:42.041 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:42.042 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:42.042 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:42.042 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:42.042 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:42.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:46.043 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:46.044 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:46.044 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:46.045 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:46.046 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:46.046 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:50.046 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:50.047 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:50.047 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:50.048 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:50.048 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:50.048 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:50.048 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:50.048 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:50.049 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:54.049 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:54.050 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:54.051 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:54.052 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:58.051 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:03:58.052 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:03:58.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:02.053 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:02.054 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:02.054 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:02.054 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:02.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:02.056 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:02.056 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:02.056 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:06.055 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:06.057 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:06.058 7f66e6aae2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:10.057 7f66e5899ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:10.059 7f66e5899ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:10.060 7f66e5899ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:14.059 7f66e58aad68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:14.061 7f66e58aad68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:14.061 7f66e58aad68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:14.061 7f66e58aad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:14.062 7f66e58aad68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:18.061 7f66e6aa5240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:18.062 7f66e6aa5240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:18.063 7f66e6aa5240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:18.064 7f66e6aa5240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:18.064 7f66e6aa5240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:18.064 7f66e6aa5240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:18.064 7f66e6aa5240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:18.064 7f66e6aa5240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:22.063 7f66ec822e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:22.064 7f66ec822e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:22.065 7f66ec822e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:26.064 7f66e6abbe10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:26.068 7f66e6abbe10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:26.069 7f66e6abbe10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:30.068 7f66e6aa50f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:30.069 7f66e6aa50f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:30.069 7f66e6aa50f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:30.069 7f66e6aa50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:30.069 7f66e6aa50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:30.069 7f66e6aa50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:30.070 7f66e6aa50f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:34.072 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:34.074 7f66e7967cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:34.074 7f66e7967cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:34.074 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:34.075 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:34.075 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:34.075 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:34.075 7f66e7967cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:34.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:38.075 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:38.076 7f66e7967cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:38.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:38.076 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:38.077 7f66e7967cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:38.078 7f66e7967cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:38.078 7f66e7967cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.040 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 08/18/2025 05:04:42.040 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: initializing cassandra cluster 08/18/2025 05:04:42.040 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 08/18/2025 05:04:42.040 7f66ec689978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.041 7f66ec689978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:42.041 7f66ec689978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.042 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 08/18/2025 05:04:42.078 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:42.079 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:42.080 7f66e6bb0ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.089 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 08/18/2025 05:04:42.092 7f66e58bd4e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.092 7f66e58bd4e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 08/18/2025 05:04:42.092 7f66e58bd4e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.103 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 08/18/2025 05:04:42.104 7f66e58bd2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.104 7f66e58bd2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:42.104 7f66e58bd2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:42.119 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:42.935 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created 08/18/2025 05:04:42.942 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:42.948 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:44.181 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 08/18/2025 05:04:44.191 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:44.191 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 08/18/2025 05:04:44.298 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 08/18/2025 05:04:44.308 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:45.317 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created 08/18/2025 05:04:45.323 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:45.335 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:45.870 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000} 08/18/2025 05:04:45.878 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:45.890 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:46.080 7f66e5695eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:46.082 7f66e5695eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:46.084 7f66e5695eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:46.084 7f66e5695eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:46.084 7f66e5695eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:46.084 7f66e5695eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:46.084 7f66e5695eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:46.085 7f66e5695eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:46.086 7f66e5695eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:46.802 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created 08/18/2025 05:04:46.811 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:46.827 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:47.943 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000} 08/18/2025 05:04:47.949 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:47.956 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:48.294 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created 08/18/2025 05:04:48.298 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:48.305 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:48.777 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000} 08/18/2025 05:04:48.782 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:48.790 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:49.188 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created 08/18/2025 05:04:49.193 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:49.201 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change... 08/18/2025 05:04:49.891 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000} 08/18/2025 05:04:49.895 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Zookeeper lock released. 08/18/2025 05:04:49.897 7f66ec7e8438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.897 7f66ec7e8438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:49.897 7f66ec7e8438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.976 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 08/18/2025 05:04:49.979 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 08/18/2025 05:04:49.980 7f66e56a7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.980 7f66e56a7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Initializing description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:04:49.980 7f66e56a7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.980 7f66e56a7c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.980 7f66e56a7c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:04:49.981 7f66e56a7c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.987 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 08/18/2025 05:04:49.988 7f66e56a7d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:49.988 7f66e56a7d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:49.988 7f66e56a7d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.030 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/18/2025 05:04:50.031 7f66e56854e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.031 7f66e56854e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:04:50.031 7f66e56854e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.034 7f66ef6ca5c8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/18/2025 05:04:50.034 7f66e5685eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.035 7f66e5685eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:50.035 7f66e5685eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.036 7f66e5685630 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 08/18/2025 05:04:50.037 7f66e56822e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.037 7f66e56822e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 08/18/2025 05:04:50.037 7f66e56822e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.061 7f66e5685630 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 08/18/2025 05:04:50.062 7f66e57366d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.062 7f66e57366d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:50.062 7f66e57366d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.082 7f66e56a1b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:50.083 7f66e56a1b70 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:50.084 7f66e56a1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:50.084 7f66e56a1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:50.084 7f66e56a1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:50.084 7f66e56a1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:50.084 7f66e56a1b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:50.085 7f66e56a1b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:54.084 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:54.085 7f66e56a2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:54.086 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:54.087 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:54.087 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:54.087 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:54.087 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:58.086 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:04:58.087 7f66e56a2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:04:58.087 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:04:58.087 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:04:58.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:02.088 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:02.090 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:05:02.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:06.091 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:06.092 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.38:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:05:06.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:10.093 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 08/18/2025 05:05:10.094 7f66e56a2a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 136 http_port = 8096 start_time = 1755493378013105 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.48:8086, 10.0.0.38:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 08/18/2025 05:05:10.095 7f66e56a2a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 08/18/2025 05:05:12.537 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'id_perms': {'created': '2025-08-18T05:05:12.526122', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:12.526122', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11104596596396375708, 'uuid_mslong': 12515549528468244562}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'adb029fc-6528-4852-9a1b-73c50e37be9c'}, 'oper': 'CREATE', 'request-id': 'req-9f9f91f0-a61f-4951-a29a-47a84a2cfcff', 'type': 'analytics_node', 'uuid': 'adb029fc-6528-4852-9a1b-73c50e37be9c'} 08/18/2025 05:05:12.591 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'id_perms': {'created': '2025-08-18T05:05:12.577517', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:12.577517', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10540097577913052701, 'uuid_mslong': 15766058646128773934}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dacc4ace-767b-4b2e-9245-f2e73d766e1d'}, 'oper': 'CREATE', 'request-id': 'req-e5095c5a-3e43-4667-9c67-519662226681', 'type': 'analytics_node', 'uuid': 'dacc4ace-767b-4b2e-9245-f2e73d766e1d'} 08/18/2025 05:05:12.604 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'id_perms': {'created': '2025-08-18T05:05:12.582287', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:12.582287', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9542884546286745168, 'uuid_mslong': 6136445552789178728}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '552908b7-cd86-4968-846f-22ef39fc7650'}, 'oper': 'CREATE', 'request-id': 'req-a623c1d3-3783-4f54-90f2-1f9e70c55198', 'type': 'analytics_node', 'uuid': '552908b7-cd86-4968-846f-22ef39fc7650'} 08/18/2025 05:05:14.094 7f66e5685d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 08/18/2025 05:05:14.096 7f66e5685d68 [contrail-device-manager] [INFO]: Session Event: TCP Connected 08/18/2025 05:05:14.096 7f66e5685d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 08/18/2025 05:05:14.096 7f66e5685d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:14.096 7f66e5685d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-3874-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.48:8082, ] status = Up description = ApiServer Connection State updated >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 08/18/2025 05:05:14.096 7f66e5685d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 08/18/2025 05:05:14.097 7f66e5685d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 08/18/2025 05:05:14.097 7f66e5685d68 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 08/18/2025 05:05:14.100 7f66e5685d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 08/18/2025 05:05:14.100 7f66e5685d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/18/2025 05:05:14.100 7f66e5685d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 08/18/2025 05:05:14.100 7f66e6a8f2e8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/18/2025 05:05:14.101 7f66e6a8f2e8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/18/2025 05:05:23.524 7f66e5871b70 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001016 08/18/2025 05:05:23.524 7f66e5871b70 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/18/2025 05:05:23.524 7f66e593c438 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 08/18/2025 05:05:23.525 7f66e593c438 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 08/18/2025 05:05:23.525 7f66e593c438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/18/2025 05:05:23.525 7f66e593c438 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/18/2025 05:05:23.525 7f66e593c438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 08/18/2025 05:05:23.525 7f66e58bd6d8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 08/18/2025 05:05:23.526 7f66e58bd6d8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 08/18/2025 05:05:28.691 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'id_perms': {'created': '2025-08-18T05:05:28.654232', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:28.654232', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11436166072159206561, 'uuid_mslong': 10571620831406935557}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '92b5f122-a421-4e05-9eb5-6c73836c7ca1'}, 'oper': 'CREATE', 'request-id': 'req-fa22cc5a-96e8-48ba-b24a-05f16ec127d8', 'type': 'analytics_alarm_node', 'uuid': '92b5f122-a421-4e05-9eb5-6c73836c7ca1'} 08/18/2025 05:05:28.784 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'id_perms': {'created': '2025-08-18T05:05:28.755423', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:28.755423', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11816668117723682391, 'uuid_mslong': 11252510578284907044}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9c28f2c0-a9ff-4a24-a3fd-3d0bb19a9657'}, 'oper': 'CREATE', 'request-id': 'req-367c9b72-908a-4d3f-ba0c-645a62e22c49', 'type': 'analytics_alarm_node', 'uuid': '9c28f2c0-a9ff-4a24-a3fd-3d0bb19a9657'} 08/18/2025 05:05:28.836 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'id_perms': {'created': '2025-08-18T05:05:28.819063', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:28.819063', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11803167186758787376, 'uuid_mslong': 309147609722863790}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '044a501c-f4b1-40ae-a3cd-46053f4de130'}, 'oper': 'CREATE', 'request-id': 'req-6ab397fd-baa7-47b8-8b5d-a008ecce44bf', 'type': 'analytics_alarm_node', 'uuid': '044a501c-f4b1-40ae-a3cd-46053f4de130'} 08/18/2025 05:05:33.516 7f66e5871b70 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296 08/18/2025 05:05:33.516 7f66e5871b70 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 08/18/2025 05:05:33.517 7f66e6ad40f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 08/18/2025 05:05:33.517 7f66e6ad40f0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2 08/18/2025 05:05:33.517 7f66e6ad40f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/18/2025 05:05:33.517 7f66e6ad40f0 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 08/18/2025 05:05:38.637 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-2.'], 'id_perms': {'created': '2025-08-18T05:05:38.611203', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:38.611203', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11913985160984265005, 'uuid_mslong': 17320813938737564761}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f05fe481-f716-4c59-a556-fa6183be012d'}, 'oper': 'CREATE', 'request-id': 'req-e932ae6e-9311-4034-af6f-f822c5b296e6', 'type': 'analytics_snmp_node', 'uuid': 'f05fe481-f716-4c59-a556-fa6183be012d'} 08/18/2025 05:05:38.734 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-1.'], 'id_perms': {'created': '2025-08-18T05:05:38.714839', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:38.714839', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12409278146288111983, 'uuid_mslong': 11811700063872894627}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a3eb96a0-849a-46a3-ac36-9cba1485516f'}, 'oper': 'CREATE', 'request-id': 'req-6bad956c-09a8-4000-986d-01b216251499', 'type': 'analytics_snmp_node', 'uuid': 'a3eb96a0-849a-46a3-ac36-9cba1485516f'} 08/18/2025 05:05:38.765 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-3874-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-3874-3.'], 'id_perms': {'created': '2025-08-18T05:05:38.725865', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:05:38.725865', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9254339980094447296, 'uuid_mslong': 1002198686016029745}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0de88665-2259-4431-806e-052e28399ec0'}, 'oper': 'CREATE', 'request-id': 'req-5d7fb305-fa2d-48a9-a412-d548fb77e5a2', 'type': 'analytics_snmp_node', 'uuid': '0de88665-2259-4431-806e-052e28399ec0'} 08/18/2025 05:07:17.962 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-9f37fc3a-d6b8-4928-868f-e8e1a9b0ef1a', 'type': 'global_system_config', 'uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88'} 08/18/2025 05:07:18.010 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e2061a4e-deb0-4f90-a952-2ae9d58d99f7', 'type': 'global_system_config', 'uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88'} 08/18/2025 05:07:18.115 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3874-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-1'], 'id_perms': {'created': '2025-08-18T05:07:18.106425', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:07:18.106425', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12589188260490598409, 'uuid_mslong': 11769527161041536519}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a355c298-6831-4607-aeb5-c805c50f5809', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-c2acab5b-775d-4696-8903-619d4f2ec79c', 'type': 'virtual_router', 'uuid': 'a355c298-6831-4607-aeb5-c805c50f5809'} 08/18/2025 05:07:18.169 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3874-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-2'], 'id_perms': {'created': '2025-08-18T05:07:18.158070', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:07:18.158070', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9324349541929075704, 'uuid_mslong': 8125367531197058915}}, 'parent_type': 'global-system-config', 'parent_uuid': '48c84a26-2b97-4e8d-a20a-194ed3efbd88', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '70c31ab8-367e-4f63-8166-be81804243f8', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-ffdf3ca2-4b7c-45df-bf89-5c06af1eaf66', 'type': 'virtual_router', 'uuid': '70c31ab8-367e-4f63-8166-be81804243f8'} 08/18/2025 05:07:18.469 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-1', 'vhost0'], 'id_perms': {'created': '2025-08-18T05:07:18.440322', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:07:18.440322', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9524074948190118436, 'uuid_mslong': 3511479158552608779}}, 'parent_type': 'virtual-router', 'parent_uuid': 'a355c298-6831-4607-aeb5-c805c50f5809', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '30bb47b0-a9b7-400b-842c-4fb46511a224', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:30:bb:47:b0:a9']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1119d935-d945-4426-a17d-42a8f8142ad9'}]}, 'oper': 'CREATE', 'request-id': 'req-e93d8a36-e8e5-49f8-b3d3-e47179e054ce', 'type': 'virtual_machine_interface', 'uuid': '30bb47b0-a9b7-400b-842c-4fb46511a224'} 08/18/2025 05:07:18.518 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e93d8a36-e8e5-49f8-b3d3-e47179e054ce', 'type': 'virtual_machine_interface', 'uuid': '30bb47b0-a9b7-400b-842c-4fb46511a224'} 08/18/2025 05:07:18.558 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-2', 'vhost0'], 'id_perms': {'created': '2025-08-18T05:07:18.532705', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-08-18T05:07:18.532705', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13265525324021913412, 'uuid_mslong': 15179850886098076812}}, 'parent_type': 'virtual-router', 'parent_uuid': '70c31ab8-367e-4f63-8166-be81804243f8', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd2a9a9f4-6146-448c-b818-9cff99465744', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:d2:a9:a9:f4:61']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1119d935-d945-4426-a17d-42a8f8142ad9'}]}, 'oper': 'CREATE', 'request-id': 'req-b79171f9-4a06-41fe-bfb3-894e0cb1b5c3', 'type': 'virtual_machine_interface', 'uuid': 'd2a9a9f4-6146-448c-b818-9cff99465744'} 08/18/2025 05:07:18.606 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-3874-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-b79171f9-4a06-41fe-bfb3-894e0cb1b5c3', 'type': 'virtual_machine_interface', 'uuid': 'd2a9a9f4-6146-448c-b818-9cff99465744'} 08/18/2025 05:07:19.008 7f66e5685eb8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-0498559a-fc41-4739-8894-c23142e42e97', 'type': 'access_control_list', 'uuid': 'f69a96a0-493d-4bca-a1d1-cce3300f1745'} 08/18/2025 05:07:34.707 7f66e79d16d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/18/2025 05:08:10.948 7f66e568e6d8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 08/18/2025 05:09:35.736 7f66e6e1ceb8 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map