03/12/2026 05:19:12.136 7f3e50d23348 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
03/12/2026 05:19:12.137 7f3e50d23348 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
03/12/2026 05:19:12.137 7f3e50d23348 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
03/12/2026 05:19:12.137 7f3e48365048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
03/12/2026 05:19:12.137 7f3e48365048 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-5463-3., 1> in the [ObjectConfigNode:NodeStatusUVE] map
03/12/2026 05:19:12.137 7f3e48365048 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1773292752137868  collector_name =   collector_ip =   collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
03/12/2026 05:19:12.138 7f3e48365048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.210 7f3e50d23348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//']
03/12/2026 05:19:12.220 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
03/12/2026 05:19:12.221 7f3e482b52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.221 7f3e482b52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.221 7f3e482b52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.222 7f3e482b52e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.222 7f3e482b52e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.222 7f3e482b52e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.229 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e4835f470>
03/12/2026 05:19:12.229 7f3e482b5828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.230 7f3e482b5828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
03/12/2026 05:19:12.230 7f3e482b5828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.272 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
03/12/2026 05:19:12.273 7f3e482c34e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.273 7f3e482c34e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.273 7f3e482c34e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.278 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e482dd978>
03/12/2026 05:19:12.278 7f3e56b65978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.278 7f3e56b65978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
03/12/2026 05:19:12.278 7f3e56b65978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.315 7f3e50d23348 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
03/12/2026 05:19:12.315 7f3e50d23348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
03/12/2026 05:19:12.315 7f3e50d23348 [contrail-device-manager] [WARNING]: initializing cassandra cluster
03/12/2026 05:19:12.315 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
03/12/2026 05:19:12.316 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
03/12/2026 05:19:12.316 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
03/12/2026 05:19:12.316 7f3e482b5ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
03/12/2026 05:19:12.317 7f3e482b5ac8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
03/12/2026 05:19:12.317 7f3e48154828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.317 7f3e48154828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.318 7f3e48154828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.319 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
03/12/2026 05:19:12.333 7f3e482b5ac8 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:12.333 7f3e4dbea6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:12.333 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
03/12/2026 05:19:12.430 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
03/12/2026 05:19:12.432 7f3e4812aeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.433 7f3e4812aeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.433 7f3e4812aeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.442 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
03/12/2026 05:19:12.442 7f3e4801bf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.442 7f3e4801bf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:12.442 7f3e4801bf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:12.453 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
03/12/2026 05:19:12.500 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
03/12/2026 05:19:14.901 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:15.941 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
03/12/2026 05:19:15.948 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:16.138 7f3e48023d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:16.139 7f3e48023d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:16.139 7f3e48023d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:16.139 7f3e48023d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:16.139 7f3e48023d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:16.140 7f3e48023d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:16.141 7f3e48023d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:16.141 7f3e48023d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:16.141 7f3e48023d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:16.864 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:17.803 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:19:17.811 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:19.906 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:20.139 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:20.141 7f3e480524e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:20.141 7f3e480524e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:20.141 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:20.141 7f3e480524e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:20.142 7f3e480524e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:20.878 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
03/12/2026 05:19:20.887 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:23.231 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:24.008 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:19:24.014 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:24.142 7f3e48034780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:24.143 7f3e48034780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:24.144 7f3e48034780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:25.976 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:25.980 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
03/12/2026 05:19:25.992 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:28.025 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:19:28.144 7f3e48052c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:28.145 7f3e48052c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:28.146 7f3e48052c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.938 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:19:28.944 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:19:28.945 7f3e480524e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.945 7f3e480524e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:28.946 7f3e480524e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.965 7f3e50d23348 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
03/12/2026 05:19:28.967 7f3e437caac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.967 7f3e437caac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
03/12/2026 05:19:28.967 7f3e437caac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.977 7f3e437caac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.978 7f3e437caac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:28.978 7f3e437caac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:28.978 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
03/12/2026 05:19:28.978 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
03/12/2026 05:19:28.979 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
03/12/2026 05:19:28.980 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5463-3.
03/12/2026 05:19:28.985 7f3e4dbea6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:29.086 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5463-3.']
03/12/2026 05:19:29.101 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
03/12/2026 05:19:29.106 7f3e4dbea6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:29.134 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5463-3.']
03/12/2026 05:19:29.492 7f3e50d23348 [contrail-device-manager] [DEBUG]: Fetching all containers
03/12/2026 05:19:29.574 7f3e50d23348 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
03/12/2026 05:19:29.739 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..config_queue
03/12/2026 05:19:29.739 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..tftp_queue
03/12/2026 05:19:30.153 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
03/12/2026 05:19:30.169 7f3e4dbea6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:30.240 7f3e50d23348 [contrail-device-manager] [WARNING]: Process 140 prepared to run in Full mode...
03/12/2026 05:19:30.240 7f3e50d23348 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
03/12/2026 05:19:30.240 7f3e50d23348 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
03/12/2026 05:19:30.243 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
03/12/2026 05:19:30.243 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
03/12/2026 05:19:30.244 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
03/12/2026 05:19:30.244 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
03/12/2026 05:19:30.245 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
03/12/2026 05:19:30.245 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
03/12/2026 05:19:30.249 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
03/12/2026 05:19:30.250 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
03/12/2026 05:19:30.251 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
03/12/2026 05:19:30.251 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
03/12/2026 05:19:30.251 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
03/12/2026 05:19:30.251 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
03/12/2026 05:19:30.251 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
03/12/2026 05:19:30.252 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
03/12/2026 05:19:30.253 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
03/12/2026 05:19:30.253 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
03/12/2026 05:19:30.253 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
03/12/2026 05:19:30.254 7f3e50d23348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
03/12/2026 05:19:30.257 7f3e50d23348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
03/12/2026 05:19:30.312 7f3e43708b70 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
03/12/2026 05:19:30.312 7f3e43708b70 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
03/12/2026 05:19:30.313 7f3e42f5a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:30.313 7f3e42f5a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:30.313 7f3e42f5a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:30.323 7f3e42e25780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:30.324 7f3e42e25780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:30.324 7f3e42e25780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:30.453 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5463-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..tftp_queue', 'device_manager_ztp.ztp_queue']
03/12/2026 05:19:30.499 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
03/12/2026 05:19:30.509 7f3e4dbea6d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155fd0>
03/12/2026 05:19:30.569 7f3e4dbea6d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5463-3.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5463-3..tftp_queue', 'device_manager_ztp.ztp_queue']
03/12/2026 05:19:32.146 7f3e42e9cc18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:32.147 7f3e42e9cc18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:32.147 7f3e42e9cc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:32.148 7f3e42e9cc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:32.149 7f3e42e9cc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:32.149 7f3e42e9cc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.149 7f3e42ddba20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:36.151 7f3e42ddba20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:36.151 7f3e42ddba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:36.152 7f3e42ddba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.153 7f3e42ddba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
03/12/2026 05:19:36.153 7f3e42ddba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.153 7f3e42ddba20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.153 7f3e42ddba20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:36.153 7f3e42ddba20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.475 7f3e42cb3f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:36.476 7f3e42cb3f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:36.476 7f3e42cb3f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:40.152 7f3e481070f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:40.154 7f3e481070f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:40.155 7f3e481070f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:40.156 7f3e481070f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:44.154 7f3e42c254e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:44.155 7f3e42c254e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:44.156 7f3e42c254e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:44.156 7f3e42c254e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:44.156 7f3e42c254e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:19:44.156 7f3e42c254e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:44.156 7f3e42c254e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:44.157 7f3e42c254e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:48.156 7f3e48f02780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:48.157 7f3e48f02780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:48.158 7f3e48f02780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:48.159 7f3e48f02780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:48.159 7f3e48f02780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:48.159 7f3e48f02780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:48.159 7f3e48f02780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:52.158 7f3e42dc4f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:52.160 7f3e42dc4f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:52.161 7f3e42dc4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:52.162 7f3e42dc4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:52.162 7f3e42dc4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:52.162 7f3e42dc4f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:52.162 7f3e42dc4f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:52.162 7f3e42dc4f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:56.161 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:19:56.162 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:19:56.162 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:19:56.162 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:19:56.163 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:00.162 7f3e4ddcc438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:00.163 7f3e4ddcc438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:00.164 7f3e4ddcc438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:00.165 7f3e4ddcc438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:00.165 7f3e4ddcc438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:00.165 7f3e4ddcc438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:04.164 7f3e4dda3c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:04.165 7f3e4dda3c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:04.165 7f3e4dda3c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:04.166 7f3e4dda3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:04.167 7f3e4dda3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:04.167 7f3e4dda3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:08.166 7f3e48042198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:08.167 7f3e48042198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:08.167 7f3e48042198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:08.167 7f3e48042198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:08.167 7f3e48042198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:08.168 7f3e48042198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:12.167 7f3e42c25390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:12.168 7f3e42c25390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:12.168 7f3e42c25390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:12.168 7f3e42c25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:12.168 7f3e42c25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:12.169 7f3e42c25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:16.169 7f3e42c25e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:16.170 7f3e42c25e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:16.171 7f3e42c25e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:16.172 7f3e42c25e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:20.171 7f3e42c2af60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:20.172 7f3e42c2af60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:20.173 7f3e42c2af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:20.174 7f3e42c2af60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:20.174 7f3e42c2af60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:20.174 7f3e42c2af60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:20.174 7f3e42c2af60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:20.174 7f3e42c2af60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.173 7f3e42dc4c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:24.175 7f3e42dc4c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.176 7f3e42dc4c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:24.176 7f3e42dc4c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.176 7f3e42dc4c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.176 7f3e42dc4c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:24.176 7f3e42dc4c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.846 7f3e50d23348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
03/12/2026 05:20:24.847 7f3e50d23348 [contrail-device-manager] [WARNING]: initializing cassandra cluster
03/12/2026 05:20:24.847 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
03/12/2026 05:20:24.847 7f3e42cedf60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.848 7f3e42cedf60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:24.848 7f3e42cedf60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.849 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
03/12/2026 05:20:24.911 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
03/12/2026 05:20:24.913 7f3e42e9f390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.913 7f3e42e9f390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
03/12/2026 05:20:24.913 7f3e42e9f390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.925 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
03/12/2026 05:20:24.925 7f3e42e9f198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.925 7f3e42e9f198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:24.925 7f3e42e9f198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:24.963 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:25.840 7f3e50d23348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
03/12/2026 05:20:25.845 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:25.852 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:26.963 7f3e50d23348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
03/12/2026 05:20:26.971 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:26.972 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
03/12/2026 05:20:27.055 7f3e50d23348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
03/12/2026 05:20:27.063 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:28.001 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
03/12/2026 05:20:28.012 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:28.033 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:28.175 7f3e42e25390 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:28.177 7f3e42e25390 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:28.178 7f3e42e25390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:28.964 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:20:28.969 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:28.976 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:29.949 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
03/12/2026 05:20:29.958 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:29.967 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:31.252 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:20:31.257 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:31.265 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:32.177 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:32.178 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:32.178 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:32.179 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:32.180 7f3e42dc4eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:32.180 7f3e42dc4eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:32.917 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
03/12/2026 05:20:32.922 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:32.933 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:33.831 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:20:33.836 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:33.843 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:34.985 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
03/12/2026 05:20:34.993 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:35.001 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
03/12/2026 05:20:35.950 7f3e50d23348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
03/12/2026 05:20:35.957 7f3e50d23348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
03/12/2026 05:20:35.958 7f3e42dde978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:35.958 7f3e42dde978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:35.958 7f3e42dde978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.022 7f3e50d23348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.19:5673//']
03/12/2026 05:20:36.022 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
03/12/2026 05:20:36.023 7f3e42dfb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.023 7f3e42dfb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:20:36.023 7f3e42dfb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.023 7f3e42dfb390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.023 7f3e42dfb390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:20:36.024 7f3e42dfb390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.032 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e48155b70>
03/12/2026 05:20:36.032 7f3e42dfbd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.032 7f3e42dfbd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:36.032 7f3e42dfbd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.096 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
03/12/2026 05:20:36.097 7f3e42decc18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.098 7f3e42decc18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:20:36.098 7f3e42decc18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.112 7f3e50d23348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e42bfb6a0>
03/12/2026 05:20:36.113 7f3e42df2390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.113 7f3e42df2390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:36.113 7f3e42df2390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.115 7f3e42deceb8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
03/12/2026 05:20:36.115 7f3e42dad780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.116 7f3e42dad780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
03/12/2026 05:20:36.116 7f3e42dad780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.122 7f3e42deceb8 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.50:5673// at 0x7f3e42bfb6a0>
03/12/2026 05:20:36.122 7f3e42dffac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.123 7f3e42dffac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:36.123 7f3e42dffac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.179 7f3e42dfb198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:36.182 7f3e42dfb198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:36.183 7f3e42dfb198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:37.131 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'],
 'oper': 'UPDATE',
 'request-id': 'req-36c4916c-da5a-40d1-a49e-dc9cc371325d',
 'type': 'global_vrouter_config',
 'uuid': '064923ea-ce43-422c-ac33-dba9cb98551d'}
03/12/2026 05:20:37.357 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'],
 'oper': 'UPDATE',
 'request-id': 'req-e1df70c1-8680-4ecf-9bc6-4883867d5e08',
 'type': 'global_vrouter_config',
 'uuid': '064923ea-ce43-422c-ac33-dba9cb98551d'}
03/12/2026 05:20:38.511 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-68f04e3f-c0be-455f-987a-bdf0aeeccdb2',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:20:38.545 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-d890d47f-a3ea-41b8-b687-f80b3990c633',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:20:40.183 7f3e48f72978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:40.184 7f3e48f72978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:40.185 7f3e48f72978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:40.185 7f3e48f72978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:40.185 7f3e48f72978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:40.185 7f3e48f72978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:40.185 7f3e48f72978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:40.186 7f3e48f72978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:40.187 7f3e48f72978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:41.804 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-2'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.254',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.254',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-2',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-5463-2'],
              'id_perms': {'created': '2026-03-12T05:20:41.779960',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:20:41.779960',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11308379073234065626,
                                    'uuid_mslong': 17200355616970459104}},
              'parent_type': 'routing-instance',
              'parent_uuid': '80cad0a4-d036-4847-ba3a-49f020c2b9ca',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'eeb3f04d-5feb-47e0-9cef-6eda4d93d8da'},
 'oper': 'CREATE',
 'request-id': 'req-c5791065-84d4-4e11-a667-cca749d4a831',
 'type': 'bgp_router',
 'uuid': 'eeb3f04d-5feb-47e0-9cef-6eda4d93d8da'}
03/12/2026 05:20:42.073 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-d427b39f-560d-47ab-ba22-f70e801f72c0',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:20:42.593 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-3'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.14',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.14',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-3',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-5463-3'],
              'id_perms': {'created': '2026-03-12T05:20:42.562643',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:20:42.562643',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10903141777531285436,
                                    'uuid_mslong': 687960881489724344}},
              'parent_type': 'routing-instance',
              'parent_uuid': '80cad0a4-d036-4847-ba3a-49f020c2b9ca',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '098c20c6-d88f-43b8-974f-bdade9792fbc'},
 'oper': 'CREATE',
 'request-id': 'req-de89b33a-1283-46c9-81ff-ea75e8f258d9',
 'type': 'bgp_router',
 'uuid': '098c20c6-d88f-43b8-974f-bdade9792fbc'}
03/12/2026 05:20:42.849 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-3'],
 'oper': 'UPDATE',
 'request-id': 'req-9e5f2658-ea71-499e-b1d5-df99fc518e28',
 'type': 'bgp_router',
 'uuid': '098c20c6-d88f-43b8-974f-bdade9792fbc'}
03/12/2026 05:20:42.888 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-2'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-9e5f2658-ea71-499e-b1d5-df99fc518e28',
 'type': 'bgp_router',
 'uuid': 'eeb3f04d-5feb-47e0-9cef-6eda4d93d8da'}
03/12/2026 05:20:42.992 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-b436b26d-dbb5-4bda-9a69-42ae1e74094f',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:20:43.321 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-1'],
 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.17',
                                        'address_families': {'family': ['route-target',
                                                                        'inet-vpn',
                                                                        'e-vpn',
                                                                        'erm-vpn',
                                                                        'inet6-vpn']},
                                        'admin_down': False,
                                        'auth_data': None,
                                        'autonomous_system': 64512,
                                        'cluster_id': None,
                                        'gateway_address': None,
                                        'hold_time': 0,
                                        'identifier': '10.20.0.17',
                                        'ipv6_gateway_address': None,
                                        'local_autonomous_system': None,
                                        'port': 179,
                                        'router_type': 'control-node',
                                        'source_port': None,
                                        'vendor': 'contrail'},
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-1',
              'fq_name': ['default-domain',
                          'default-project',
                          'ip-fabric',
                          '__default__',
                          'cn-jenkins-deploy-platform-ansible-os-5463-1'],
              'id_perms': {'created': '2026-03-12T05:20:43.310317',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:20:43.310317',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11786705333198131222,
                                    'uuid_mslong': 14474736877760168390}},
              'parent_type': 'routing-instance',
              'parent_uuid': '80cad0a4-d036-4847-ba3a-49f020c2b9ca',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'c8e0987f-f824-41c6-a392-ca0d497a1016'},
 'oper': 'CREATE',
 'request-id': 'req-37df3bb7-42e9-48c4-8d5d-6c1a1fdb89aa',
 'type': 'bgp_router',
 'uuid': 'c8e0987f-f824-41c6-a392-ca0d497a1016'}
03/12/2026 05:20:43.497 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-1'],
 'oper': 'UPDATE',
 'request-id': 'req-0f711bfc-e78d-49fe-a9cc-32e187a6ffa5',
 'type': 'bgp_router',
 'uuid': 'c8e0987f-f824-41c6-a392-ca0d497a1016'}
03/12/2026 05:20:43.517 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-2'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-0f711bfc-e78d-49fe-a9cc-32e187a6ffa5',
 'type': 'bgp_router',
 'uuid': 'eeb3f04d-5feb-47e0-9cef-6eda4d93d8da'}
03/12/2026 05:20:43.604 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-1'],
 'oper': 'UPDATE',
 'request-id': 'req-7a09f41c-a863-42a1-9a57-4a7aac2d7058',
 'type': 'bgp_router',
 'uuid': 'c8e0987f-f824-41c6-a392-ca0d497a1016'}
03/12/2026 05:20:43.610 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain',
             'default-project',
             'ip-fabric',
             '__default__',
             'cn-jenkins-deploy-platform-ansible-os-5463-3'],
 'oper': 'UPDATE-IMPLICIT',
 'request-id': 'req-7a09f41c-a863-42a1-9a57-4a7aac2d7058',
 'type': 'bgp_router',
 'uuid': '098c20c6-d88f-43b8-974f-bdade9792fbc'}
03/12/2026 05:20:43.653 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-e830e5dc-d00c-46ff-9eeb-3884c09afde5',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:20:44.185 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:44.186 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:44.187 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:44.188 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:44.188 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:44.188 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:44.188 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:48.187 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:48.188 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:48.189 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:48.190 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:48.190 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:52.190 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:52.191 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:52.191 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:52.192 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:52.193 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:52.193 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:56.193 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:20:56.194 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:20:56.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:00.195 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:00.197 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:00.198 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:04.198 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:04.199 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:04.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:04.201 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:04.201 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:04.201 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:04.201 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:04.201 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:08.200 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:08.202 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:08.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:12.203 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:12.204 7f3e48f72d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:12.205 7f3e48f72d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:16.205 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:16.206 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:16.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:20.207 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:20.209 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:20.210 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:20.210 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:20.210 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:20.210 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:24.210 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:24.211 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:24.212 7f3e4b07f588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:24.216 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:24.216 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:24.216 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:24.216 7f3e4b07f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:24.217 7f3e4b07f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:24.217 7f3e4b07f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:25.377 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.19',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
              'id_perms': {'created': '2026-03-12T05:21:25.341960',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:21:25.341960',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11239162248895073318,
                                    'uuid_mslong': 9053000046880965964}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '7da2b793-e9ef-454c-9bf9-86848a5f0c26'},
 'oper': 'CREATE',
 'request-id': 'req-607814f6-d2e6-4c7a-a97d-ce53db6c4852',
 'type': 'database_node',
 'uuid': '7da2b793-e9ef-454c-9bf9-86848a5f0c26'}
03/12/2026 05:21:25.879 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.22',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
              'id_perms': {'created': '2026-03-12T05:21:25.864729',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:21:25.864729',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11698802618394305072,
                                    'uuid_mslong': 15537951770556842284}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'd7a1e4cf-cd31-412c-a25a-7eff9ecd6230'},
 'oper': 'CREATE',
 'request-id': 'req-235a0a34-bb1a-4983-ae96-94d4e3cbbf46',
 'type': 'database_node',
 'uuid': 'd7a1e4cf-cd31-412c-a25a-7eff9ecd6230'}
03/12/2026 05:21:26.006 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
              'id_perms': {'created': '2026-03-12T05:21:25.997236',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:21:25.997236',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10571477338511792727,
                                    'uuid_mslong': 9235119287234087878}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '8029bc0f-ddf2-4bc6-92b5-6ea119165a57'},
 'oper': 'CREATE',
 'request-id': 'req-6fb0fc11-5028-452b-83c5-404e5cbb5d9f',
 'type': 'database_node',
 'uuid': '8029bc0f-ddf2-4bc6-92b5-6ea119165a57'}
03/12/2026 05:21:28.212 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:28.213 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:28.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:28.215 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:28.215 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:32.214 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:32.216 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:32.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:36.217 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:36.218 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:36.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:40.219 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:40.220 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:40.220 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:40.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:40.222 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:40.222 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:44.221 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:44.223 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:44.224 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:44.224 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:44.224 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:44.224 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:44.224 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:44.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:48.225 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:48.226 7f3e42e24d68 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:48.226 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:48.226 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:48.226 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:48.226 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:48.227 7f3e42e24d68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:52.227 7f3e42c2c978 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:52.229 7f3e42c2c978 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.22:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:52.230 7f3e42c2c978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:56.229 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:21:56.231 7f3e42dbb438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
03/12/2026 05:21:56.231 7f3e42dbb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:21:56.231 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:21:56.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:22:00.232 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [INFO]: Session Event: TCP Connected
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:22:00.233 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
03/12/2026 05:22:00.234 7f3e42dbb438 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
03/12/2026 05:22:00.234 7f3e42dbb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
03/12/2026 05:22:00.234 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
03/12/2026 05:22:00.234 7f3e42dbb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
03/12/2026 05:22:00.234 7f3e42bbd780 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
03/12/2026 05:22:00.235 7f3e42bbd780 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
03/12/2026 05:22:01.555 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.19',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
              'id_perms': {'created': '2026-03-12T05:22:01.536968',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:01.536968',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10917759534094199005,
                                    'uuid_mslong': 13732441426468422502}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'be936eb8-4382-4366-9783-ac7394d1a8dd'},
 'oper': 'CREATE',
 'request-id': 'req-da1b80b9-b9b7-42c4-aac4-0b5127396597',
 'type': 'analytics_node',
 'uuid': 'be936eb8-4382-4366-9783-ac7394d1a8dd'}
03/12/2026 05:22:01.613 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.22',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
              'id_perms': {'created': '2026-03-12T05:22:01.597709',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:01.597709',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10292953657027058090,
                                    'uuid_mslong': 7623743606617951750}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '69ccfa6a-fb1e-4e06-8ed7-ead110a7d9aa'},
 'oper': 'CREATE',
 'request-id': 'req-9d0515b4-c473-42de-8f42-b30d80b49b8c',
 'type': 'analytics_node',
 'uuid': '69ccfa6a-fb1e-4e06-8ed7-ead110a7d9aa'}
03/12/2026 05:22:01.685 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
              'id_perms': {'created': '2026-03-12T05:22:01.667466',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:01.667466',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12955242202432307454,
                                    'uuid_mslong': 5121729682874909279}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '47140a02-af55-425f-b3ca-4424af2080fe'},
 'oper': 'CREATE',
 'request-id': 'req-6ed0f5a8-d528-464d-ba7a-3dc0ec54b3a3',
 'type': 'analytics_node',
 'uuid': '47140a02-af55-425f-b3ca-4424af2080fe'}
03/12/2026 05:22:21.379 7f3e48f782e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed
03/12/2026 05:22:21.380 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit]
03/12/2026 05:22:21.380 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle]
03/12/2026 05:22:21.380 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:22:21.380 7f3e42ddeeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.19:8086,  ]  status = Down  description = ClientInit to Idle on EvTcpClose  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down  >>,  ]  >>  
03/12/2026 05:22:21.380 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:22:21.381 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:22:21.381 7f3e42ddeeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 1  pid = 140  http_port = 8096  start_time = 1773292752137868  collector_name =   collector_ip = 10.0.0.19:8086  collector_list = [ 10.0.0.22:8086, 10.0.0.50:8086, 10.0.0.19:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
03/12/2026 05:22:21.381 7f3e42ddeeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
03/12/2026 05:22:22.538 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.19',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
              'id_perms': {'created': '2026-03-12T05:22:22.523869',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:22.523869',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12012766766209715564,
                                    'uuid_mslong': 17614041926957679502}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'f471a5cf-3326-438e-a6b5-ebba3d8c4d6c'},
 'oper': 'CREATE',
 'request-id': 'req-eb690a1a-4c60-4793-9b6a-61e0bcabd9d9',
 'type': 'analytics_alarm_node',
 'uuid': 'f471a5cf-3326-438e-a6b5-ebba3d8c4d6c'}
03/12/2026 05:22:22.704 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.22',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
              'id_perms': {'created': '2026-03-12T05:22:22.690419',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:22.690419',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10492298819831566083,
                                    'uuid_mslong': 16643981427062817091}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'e6fb4cec-a047-4143-919c-222fa14f8f03'},
 'oper': 'CREATE',
 'request-id': 'req-e819fa9b-1ae2-4f51-bca5-88b5d4e43a9b',
 'type': 'analytics_alarm_node',
 'uuid': 'e6fb4cec-a047-4143-919c-222fa14f8f03'}
03/12/2026 05:22:23.356 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
              'id_perms': {'created': '2026-03-12T05:22:23.347750',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:23.347750',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9652007742210855365,
                                    'uuid_mslong': 17410930079975820901}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'f1a00ca9-221f-4e65-85f2-d1e72bcc51c5'},
 'oper': 'CREATE',
 'request-id': 'req-6cf72946-6491-4c65-bd13-031a1f11a8da',
 'type': 'analytics_alarm_node',
 'uuid': 'f1a00ca9-221f-4e65-85f2-d1e72bcc51c5'}
03/12/2026 05:22:25.381 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [INFO]: Session Event: TCP Connected
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-5463-3.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.22:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.50:5673, 10.0.0.22:5673, 10.0.0.19:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.50:9041, 10.0.0.22:9041, 10.0.0.19:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.50:2181, 10.0.0.22:2181, 10.0.0.19:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.50,10.0.0.22,10.0.0.19:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
03/12/2026 05:22:25.382 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
03/12/2026 05:22:25.383 7f3e480414e0 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
03/12/2026 05:22:25.383 7f3e480414e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
03/12/2026 05:22:25.383 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
03/12/2026 05:22:25.383 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
03/12/2026 05:22:25.383 7f3e42bbdac8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
03/12/2026 05:22:25.384 7f3e42bbdac8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
03/12/2026 05:22:25.390 7f3e483cdf60 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017
03/12/2026 05:22:25.391 7f3e483cdf60 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
03/12/2026 05:22:25.391 7f3e42de6588 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
03/12/2026 05:22:25.391 7f3e42de6588 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
03/12/2026 05:22:25.392 7f3e42de6588 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-5463-3.: 113> in the [ObjectConfigNode:NodeStatusUVE] map
03/12/2026 05:22:25.392 7f3e42de6588 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0: 45> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
03/12/2026 05:22:25.392 7f3e42de6588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
03/12/2026 05:22:25.392 7f3e48f782e8 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
03/12/2026 05:22:25.394 7f3e48f782e8 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
03/12/2026 05:22:30.958 7f3e483cdf60 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001297
03/12/2026 05:22:30.959 7f3e483cdf60 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
03/12/2026 05:22:30.959 7f3e480414e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
03/12/2026 05:22:30.959 7f3e480414e0 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
03/12/2026 05:22:30.959 7f3e480414e0 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-5463-3.: 114> in the [ObjectConfigNode:NodeStatusUVE] map
03/12/2026 05:22:30.959 7f3e480414e0 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-5463-3.:Config:contrail-device-manager:0: 46> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
03/12/2026 05:22:36.809 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.19',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-3.'],
              'id_perms': {'created': '2026-03-12T05:22:36.795475',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:36.795475',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9323326454094878622,
                                    'uuid_mslong': 14806133287418808208}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'cd79f3c7-55af-4790-8163-1c034d53d79e'},
 'oper': 'CREATE',
 'request-id': 'req-6b951805-c99a-468c-a953-450a05d802b2',
 'type': 'analytics_snmp_node',
 'uuid': 'cd79f3c7-55af-4790-8163-1c034d53d79e'}
03/12/2026 05:22:36.985 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.22',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-2.'],
              'id_perms': {'created': '2026-03-12T05:22:36.973850',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:36.973850',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11292134637878281786,
                                    'uuid_mslong': 9862733571058452083}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '88df77ed-8942-4673-9cb5-b89ff69e863a'},
 'oper': 'CREATE',
 'request-id': 'req-5c3670d1-fd6b-4f3a-8ea5-5d850c6c23af',
 'type': 'analytics_snmp_node',
 'uuid': '88df77ed-8942-4673-9cb5-b89ff69e863a'}
03/12/2026 05:22:38.884 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-5463-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-5463-1.'],
              'id_perms': {'created': '2026-03-12T05:22:38.871821',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:22:38.871821',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13232671860335912109,
                                    'uuid_mslong': 8113111369229225485}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '70978fce-2217-4e0d-b7a3-e4f280a124ad'},
 'oper': 'CREATE',
 'request-id': 'req-3787e211-d0d8-4da7-a31c-47b8daba6d47',
 'type': 'analytics_snmp_node',
 'uuid': '70978fce-2217-4e0d-b7a3-e4f280a124ad'}
03/12/2026 05:25:22.414 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-5cd4dd13-e822-41b6-aba2-7a6f34e74172',
 'type': 'global_system_config',
 'uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de'}
03/12/2026 05:25:22.572 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-5463-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-5463-2'],
              'id_perms': {'created': '2026-03-12T05:25:22.555912',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:25:22.555912',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10953516393662708505,
                                    'uuid_mslong': 16204056350536977735}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'e0e05f65-e62b-4d47-9802-b52035aefb19',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-71e55d02-4165-49a9-8308-4a4df33b6563',
 'type': 'virtual_router',
 'uuid': 'e0e05f65-e62b-4d47-9802-b52035aefb19'}
03/12/2026 05:25:22.958 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-5463-2',
                          'vhost0'],
              'id_perms': {'created': '2026-03-12T05:25:22.931943',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:25:22.931943',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12016070495031046539,
                                    'uuid_mslong': 12899303895722380802}},
              'parent_type': 'virtual-router',
              'parent_uuid': 'e0e05f65-e62b-4d47-9802-b52035aefb19',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'b303888c-ba58-4e02-a6c1-a8738c60b18b',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:b3:03:88:8c:ba']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '09c65883-b718-473c-b240-e0a3440bd2d5'}]},
 'oper': 'CREATE',
 'request-id': 'req-78e4eaba-19ad-45c0-91ea-9e187866cddc',
 'type': 'virtual_machine_interface',
 'uuid': 'b303888c-ba58-4e02-a6c1-a8738c60b18b'}
03/12/2026 05:25:23.023 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-78e4eaba-19ad-45c0-91ea-9e187866cddc',
 'type': 'virtual_machine_interface',
 'uuid': 'b303888c-ba58-4e02-a6c1-a8738c60b18b'}
03/12/2026 05:25:23.567 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-9b1bc636-0ddd-4722-b58a-2d4b5ca06f1a',
 'type': 'access_control_list',
 'uuid': '0dc7e2e3-8a83-432f-861b-ea76ee3e64c0'}
03/12/2026 05:25:26.500 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-5463-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-5463-1'],
              'id_perms': {'created': '2026-03-12T05:25:26.483388',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:25:26.483388',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10002460270470412433,
                                    'uuid_mslong': 12391437025468763615}},
              'parent_type': 'global-system-config',
              'parent_uuid': '672d370c-a10a-41eb-99c1-1a57fc1b68de',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'abf73a52-6fb0-4ddf-8acf-e09ee558b891',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-964bd5f2-87f1-49e1-ab1c-b4729ae42010',
 'type': 'virtual_router',
 'uuid': 'abf73a52-6fb0-4ddf-8acf-e09ee558b891'}
03/12/2026 05:25:26.870 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-5463-1',
                          'vhost0'],
              'id_perms': {'created': '2026-03-12T05:25:26.842297',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2026-03-12T05:25:26.842297',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11417811283215115785,
                                    'uuid_mslong': 14615420617121875344}},
              'parent_type': 'virtual-router',
              'parent_uuid': 'abf73a52-6fb0-4ddf-8acf-e09ee558b891',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'cad4679d-8e78-4590-9e74-36de307be609',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ca:d4:67:9d:8e']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '09c65883-b718-473c-b240-e0a3440bd2d5'}]},
 'oper': 'CREATE',
 'request-id': 'req-aaaaf803-71f6-4a80-8425-5eee2aa51110',
 'type': 'virtual_machine_interface',
 'uuid': 'cad4679d-8e78-4590-9e74-36de307be609'}
03/12/2026 05:25:26.927 7f3e42decac8 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-5463-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-aaaaf803-71f6-4a80-8425-5eee2aa51110',
 'type': 'virtual_machine_interface',
 'uuid': 'cad4679d-8e78-4590-9e74-36de307be609'}