07/28/2025 03:27:10.879 7f752f693348 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
07/28/2025 03:27:10.880 7f752f693348 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
07/28/2025 03:27:10.880 7f752f693348 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
07/28/2025 03:27:10.880 7f7526d792e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
07/28/2025 03:27:10.881 7f7526d792e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3721-2., 1> in the [ObjectConfigNode:NodeStatusUVE] map
07/28/2025 03:27:10.881 7f7526d792e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
07/28/2025 03:27:10.881 7f7526d792e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
07/28/2025 03:27:10.881 7f7526d792e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.882 7f7526d792e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
07/28/2025 03:27:10.882 7f7526d792e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.882 7f7526d792e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.882 7f7526d792e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip =   collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
07/28/2025 03:27:10.882 7f7526d792e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.926 7f752f693348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//']
07/28/2025 03:27:10.990 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
07/28/2025 03:27:10.992 7f7526bca588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.992 7f7526bca588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:27:10.993 7f7526bca588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.993 7f7526bca588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:10.993 7f7526bca588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:27:10.993 7f7526bca588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.007 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526d6edd8>
07/28/2025 03:27:11.010 7f7526bca240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.011 7f7526bca240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
07/28/2025 03:27:11.011 7f7526bca240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.044 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
07/28/2025 03:27:11.044 7f7526bca0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.045 7f7526bca0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:27:11.045 7f7526bca0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.049 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526bf3f98>
07/28/2025 03:27:11.049 7f753557e978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.050 7f753557e978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
07/28/2025 03:27:11.050 7f753557e978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.069 7f752f693348 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
07/28/2025 03:27:11.069 7f752f693348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
07/28/2025 03:27:11.069 7f752f693348 [contrail-device-manager] [WARNING]: initializing cassandra cluster
07/28/2025 03:27:11.070 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
07/28/2025 03:27:11.070 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
07/28/2025 03:27:11.070 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
07/28/2025 03:27:11.070 7f752951a978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
07/28/2025 03:27:11.071 7f752951a978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
07/28/2025 03:27:11.071 7f7526b5f588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.071 7f7526b5f588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:11.071 7f7526b5f588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.072 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
07/28/2025 03:27:11.077 7f752951a978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b6a3c8>
07/28/2025 03:27:11.077 7f752c6046d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b6a3c8>
07/28/2025 03:27:11.077 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
07/28/2025 03:27:11.174 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
07/28/2025 03:27:11.175 7f7526ac1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.176 7f7526ac1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
07/28/2025 03:27:11.176 7f7526ac1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.183 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
07/28/2025 03:27:11.183 7f7526ab6e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.184 7f7526ab6e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:11.184 7f7526ab6e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:11.211 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
07/28/2025 03:27:11.267 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
07/28/2025 03:27:13.889 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:14.881 7f7526a606d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:14.882 7f7526a606d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:14.883 7f7526a606d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:14.884 7f7526a606d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:14.884 7f7526a606d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:14.884 7f7526a606d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:14.884 7f7526a606d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:15.044 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
07/28/2025 03:27:15.051 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:18.883 7f75261dbeb8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:18.884 7f75261dbeb8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:18.885 7f75261dbeb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:19.177 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:21.009 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:27:21.020 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:22.822 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:22.885 7f7526200438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:22.888 7f7526200438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:22.888 7f7526200438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:22.888 7f7526200438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:22.888 7f7526200438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:22.889 7f7526200438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:23.934 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
07/28/2025 03:27:23.942 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:25.963 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:26.889 7f7526ab6c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:26.890 7f7526ab6c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:26.891 7f7526ab6c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:27.476 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:27:27.493 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:29.874 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:29.876 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
07/28/2025 03:27:29.883 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:30.892 7f752c35b048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:30.893 7f752c35b048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:30.893 7f752c35b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:30.893 7f752c35b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:30.894 7f752c35b048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:30.895 7f752c35b048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:30.895 7f752c35b048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:31.935 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:27:32.867 7f752f693348 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:27:32.873 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:27:32.874 7f7526ac1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.874 7f7526ac1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:32.874 7f7526ac1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.893 7f752f693348 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
07/28/2025 03:27:32.894 7f7526a4c198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.895 7f7526a4c198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
07/28/2025 03:27:32.895 7f7526a4c198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.904 7f75262050f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.904 7f75262050f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:32.904 7f75262050f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:32.904 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
07/28/2025 03:27:32.905 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
07/28/2025 03:27:32.905 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
07/28/2025 03:27:32.905 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3721-2.
07/28/2025 03:27:32.909 7f752c6046d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b6a3c8>
07/28/2025 03:27:33.215 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3721-2.']
07/28/2025 03:27:33.237 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
07/28/2025 03:27:33.243 7f752c6046d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b6a3c8>
07/28/2025 03:27:33.288 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3721-2.']
07/28/2025 03:27:33.417 7f752f693348 [contrail-device-manager] [DEBUG]: Fetching all containers
07/28/2025 03:27:33.474 7f752f693348 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
07/28/2025 03:27:33.637 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3721-2..config_queue
07/28/2025 03:27:33.637 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3721-2..tftp_queue
07/28/2025 03:27:34.138 7f752f693348 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode...
07/28/2025 03:27:34.138 7f752f693348 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
07/28/2025 03:27:34.138 7f752f693348 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
07/28/2025 03:27:34.142 7f752f693348 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
07/28/2025 03:27:34.142 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
07/28/2025 03:27:34.142 7f752f693348 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
07/28/2025 03:27:34.143 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
07/28/2025 03:27:34.143 7f752f693348 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
07/28/2025 03:27:34.143 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
07/28/2025 03:27:34.147 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
07/28/2025 03:27:34.148 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
07/28/2025 03:27:34.148 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
07/28/2025 03:27:34.148 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
07/28/2025 03:27:34.148 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
07/28/2025 03:27:34.148 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
07/28/2025 03:27:34.149 7f752f693348 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
07/28/2025 03:27:34.149 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
07/28/2025 03:27:34.149 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
07/28/2025 03:27:34.149 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
07/28/2025 03:27:34.150 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
07/28/2025 03:27:34.151 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
07/28/2025 03:27:34.151 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
07/28/2025 03:27:34.152 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
07/28/2025 03:27:34.154 7f752f693348 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
07/28/2025 03:27:34.156 7f752f693348 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
07/28/2025 03:27:34.212 7f752616e780 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
07/28/2025 03:27:34.212 7f752616e780 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
07/28/2025 03:27:34.212 7f752592e048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.212 7f752592e048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:34.213 7f752592e048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.225 7f75258780f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.225 7f75258780f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:34.225 7f75258780f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.311 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
07/28/2025 03:27:34.320 7f752c6046d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b6a3c8>
07/28/2025 03:27:34.678 7f752c6046d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3721-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3721-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3721-2..tftp_queue', 'device_manager_ztp.ztp_queue']
07/28/2025 03:27:34.894 7f7525878c18 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:34.896 7f7525878c18 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:34.897 7f7525878c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:38.897 7f752593c588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:38.898 7f752593c588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:38.899 7f752593c588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:40.357 7f7525864ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:40.357 7f7525864ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:40.357 7f7525864ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:42.899 7f752571a0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:42.901 7f752571a0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:42.902 7f752571a0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:42.903 7f752571a0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:46.902 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:46.903 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:46.904 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:46.905 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:46.905 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:46.905 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:46.905 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:50.905 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:50.906 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:50.907 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:54.906 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:54.908 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:54.909 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:54.909 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:54.909 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:54.909 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:54.909 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:58.908 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:27:58.910 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:27:58.911 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:02.911 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:02.912 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:02.913 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:06.912 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:06.914 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:06.915 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:10.915 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:10.917 7f7526205588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:10.918 7f7526205588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:14.917 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:14.918 7f7526a4c2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:14.918 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:14.918 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:14.918 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:14.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:18.919 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:18.921 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:18.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:22.922 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:22.923 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:22.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:26.924 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:26.925 7f7526a4c2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:26.926 7f7526a4c2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:30.926 7f752592e198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:30.927 7f752592e198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:30.927 7f752592e198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:30.927 7f752592e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:30.927 7f752592e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:30.927 7f752592e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:30.928 7f752592e198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:34.927 7f752592ea20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:34.929 7f752592ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:34.930 7f752592ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:34.930 7f752592ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:34.930 7f752592ea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:34.930 7f752592ea20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:34.930 7f752592ea20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:38.929 7f752585b828 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:38.930 7f752585b828 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:38.931 7f752585b828 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:38.932 7f752585b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:38.932 7f752585b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:38.933 7f752585b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:38.934 7f752585b828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:38.934 7f752585b828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:38.934 7f752585b828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:42.931 7f752c7cb438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:42.933 7f752c7cb438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:42.934 7f752c7cb438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:46.933 7f75257970f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:46.935 7f75257970f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:46.936 7f75257970f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:46.936 7f75257970f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:46.936 7f75257970f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:46.936 7f75257970f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:50.935 7f75257974e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:50.936 7f75257974e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:50.937 7f75257974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:50.938 7f75257974e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:50.938 7f75257974e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:50.938 7f75257974e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:54.937 7f7526bc5780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:54.939 7f7526bc5780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:54.939 7f7526bc5780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:54.939 7f7526bc5780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:54.940 7f7526bc5780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:54.940 7f7526bc5780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:54.940 7f7526bc5780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:54.940 7f7526bc5780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:54.940 7f7526bc5780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:54.941 7f7526bc5780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:54.941 7f7526bc5780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:54.941 7f7526bc5780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:54.941 7f7526bc5780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:54.941 7f7526bc5780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:58.939 7f7525731198 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:28:58.943 7f7525731198 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:28:58.944 7f7525731198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:02.943 7f7526b2a438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:02.944 7f7526b2a438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:02.944 7f7526b2a438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:02.944 7f7526b2a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:02.945 7f7526b2a438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:06.946 7f7526205630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:06.947 7f7526205630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:06.948 7f7526205630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:06.949 7f7526205630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:06.949 7f7526205630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:06.949 7f7526205630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:06.949 7f7526205630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.040 7f752f693348 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
07/28/2025 03:29:08.040 7f752f693348 [contrail-device-manager] [WARNING]: initializing cassandra cluster
07/28/2025 03:29:08.041 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
07/28/2025 03:29:08.041 7f75257be630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.041 7f75257be630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:08.041 7f75257be630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.042 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
07/28/2025 03:29:08.071 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
07/28/2025 03:29:08.072 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.073 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
07/28/2025 03:29:08.073 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.079 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
07/28/2025 03:29:08.079 7f7525774630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.080 7f7525774630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:08.080 7f7525774630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:08.091 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:08.977 7f752f693348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
07/28/2025 03:29:08.982 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:08.988 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:10.051 7f752f693348 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
07/28/2025 03:29:10.056 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:10.056 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
07/28/2025 03:29:10.197 7f752f693348 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
07/28/2025 03:29:10.206 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:10.948 7f752580cac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:10.949 7f752580cac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:10.949 7f752580cac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:10.949 7f752580cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:10.950 7f752580cac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:10.951 7f752580cac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:11.025 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
07/28/2025 03:29:11.030 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:11.038 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:11.929 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:29:11.936 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:11.946 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:13.099 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
07/28/2025 03:29:13.105 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:13.110 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:14.044 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:29:14.049 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:14.055 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:14.950 7f75257c6630 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:14.951 7f75257c6630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:14.952 7f75257c6630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
07/28/2025 03:29:14.952 7f75257c6630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:14.952 7f75257c6630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:14.952 7f75257c6630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:14.952 7f75257c6630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:14.987 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
07/28/2025 03:29:14.993 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:14.999 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:16.093 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:29:16.099 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:16.112 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:17.102 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
07/28/2025 03:29:17.106 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:17.112 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
07/28/2025 03:29:18.000 7f752f693348 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
07/28/2025 03:29:18.004 7f752f693348 [contrail-device-manager] [WARNING]: Zookeeper lock released.
07/28/2025 03:29:18.004 7f75261e1048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.005 7f75261e1048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:18.005 7f75261e1048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.059 7f752f693348 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//']
07/28/2025 03:29:18.060 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
07/28/2025 03:29:18.060 7f752581b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.061 7f752581b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:29:18.061 7f752581b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.061 7f752581b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.061 7f752581b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:29:18.061 7f752581b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.065 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f7526b64d68>
07/28/2025 03:29:18.065 7f752581b780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.066 7f752581b780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:18.066 7f752581b780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.155 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
07/28/2025 03:29:18.155 7f752581b390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.156 7f752581b390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:29:18.156 7f752581b390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.166 7f752f693348 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f752569e588>
07/28/2025 03:29:18.167 7f7525822eb8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.167 7f7525822eb8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:18.167 7f7525822eb8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.169 7f75257d0978 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
07/28/2025 03:29:18.169 7f7525816780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.169 7f7525816780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
07/28/2025 03:29:18.169 7f7525816780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.185 7f75257d0978 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.254:5673// at 0x7f752569e588>
07/28/2025 03:29:18.185 7f75258122e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.185 7f75258122e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:18.185 7f75258122e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.951 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:18.952 7f7525774780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:18.952 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:18.952 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:18.953 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:22.952 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:22.954 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:22.955 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:26.955 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:26.957 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.38:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:26.958 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:30.957 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:30.959 7f7525774780 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
07/28/2025 03:29:30.959 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:30.959 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.50:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:30.960 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.50:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:30.961 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:34.960 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:34.961 7f7525774780 [contrail-device-manager] [INFO]: Session Event: TCP Connected
07/28/2025 03:29:34.961 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:34.961 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:34.962 7f7525774780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:34.962 7f7525774780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:34.962 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
07/28/2025 03:29:34.962 7f7525774780 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
07/28/2025 03:29:34.962 7f7525774780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
07/28/2025 03:29:34.963 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
07/28/2025 03:29:34.963 7f7525774780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
07/28/2025 03:29:34.963 7f7525822240 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
07/28/2025 03:29:34.964 7f7525822240 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
07/28/2025 03:29:35.563 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
              'id_perms': {'created': '2025-07-28T03:29:35.549378',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:35.549378',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13174729959331522451,
                                    'uuid_mslong': 4175161950637737058}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '39f127ac-537d-4462-b6d6-0b1865a6e793'},
 'oper': 'CREATE',
 'request-id': 'req-db926d0b-7d40-4a44-b319-07d877353c5c',
 'type': 'analytics_node',
 'uuid': '39f127ac-537d-4462-b6d6-0b1865a6e793'}
07/28/2025 03:29:36.073 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
              'id_perms': {'created': '2025-07-28T03:29:36.056636',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:36.056636',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13738865434034189602,
                                    'uuid_mslong': 4802102734183877256}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '42a47efe-7df6-4a88-beaa-415214803522'},
 'oper': 'CREATE',
 'request-id': 'req-915f0f31-d3e7-4499-85a3-52a4e9da3de6',
 'type': 'analytics_node',
 'uuid': '42a47efe-7df6-4a88-beaa-415214803522'}
07/28/2025 03:29:36.221 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.254',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
              'id_perms': {'created': '2025-07-28T03:29:36.198917',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:36.198917',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10373247335761259115,
                                    'uuid_mslong': 9138601599799936438}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '7ed2d5bc-93e4-45b6-8ff5-2d7df7512a6b'},
 'oper': 'CREATE',
 'request-id': 'req-8292dbc2-4853-401b-945b-b2f7a5ef2999',
 'type': 'analytics_node',
 'uuid': '7ed2d5bc-93e4-45b6-8ff5-2d7df7512a6b'}
07/28/2025 03:29:46.960 7f75258226d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed
07/28/2025 03:29:46.960 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit]
07/28/2025 03:29:46.960 7f752579fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle]
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.254:8086,  ]  status = Down  description = ClientInit to Idle on EvTcpClose  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down  >>,  ]  >>  
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 1  pid = 138  http_port = 8096  start_time = 1753673230881376  collector_name =   collector_ip = 10.0.0.254:8086  collector_list = [ 10.0.0.38:8086, 10.0.0.50:8086, 10.0.0.254:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
07/28/2025 03:29:46.961 7f752579fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
07/28/2025 03:29:50.961 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
07/28/2025 03:29:50.962 7f752579fa20 [contrail-device-manager] [INFO]: Session Event: TCP Connected
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3721-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.38:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.254:5673, 10.0.0.38:5673, 10.0.0.50:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.254:9041, 10.0.0.38:9041, 10.0.0.50:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.254:2181, 10.0.0.38:2181, 10.0.0.50:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.254,10.0.0.38,10.0.0.50:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
07/28/2025 03:29:50.963 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
07/28/2025 03:29:50.964 7f752580cb70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
07/28/2025 03:29:50.967 7f752580cb70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
07/28/2025 03:29:50.974 7f752580c978 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017
07/28/2025 03:29:50.975 7f752580c978 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
07/28/2025 03:29:50.975 7f752579fa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
07/28/2025 03:29:50.976 7f752579fa20 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
07/28/2025 03:29:50.976 7f752579fa20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.: 101> in the [ObjectConfigNode:NodeStatusUVE] map
07/28/2025 03:29:50.976 7f752579fa20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0: 39> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
07/28/2025 03:29:50.977 7f752579fa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
07/28/2025 03:29:50.978 7f752580cb70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
07/28/2025 03:29:50.980 7f752580cb70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
07/28/2025 03:29:53.246 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
              'id_perms': {'created': '2025-07-28T03:29:53.203456',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:53.203456',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13171817616948061763,
                                    'uuid_mslong': 12678503144030031553}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'aff3176f-9795-4ec1-b6cb-b255d86be643'},
 'oper': 'CREATE',
 'request-id': 'req-abcfd555-cf82-429c-9256-58d5fca88530',
 'type': 'analytics_alarm_node',
 'uuid': 'aff3176f-9795-4ec1-b6cb-b255d86be643'}
07/28/2025 03:29:53.320 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
              'id_perms': {'created': '2025-07-28T03:29:53.213718',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:53.213718',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13769493016873064796,
                                    'uuid_mslong': 5442056830221896616}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '4b8611da-94dd-4ba8-bf17-10f1e7f0d95c'},
 'oper': 'CREATE',
 'request-id': 'req-2034e992-a698-4493-81fa-ce77d6484654',
 'type': 'analytics_alarm_node',
 'uuid': '4b8611da-94dd-4ba8-bf17-10f1e7f0d95c'}
07/28/2025 03:29:53.400 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
              'id_perms': {'created': '2025-07-28T03:29:53.366390',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:29:53.366390',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13438271687042657512,
                                    'uuid_mslong': 3608807961328765513}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '32150fb8-759a-4a49-ba7e-54e67d5dece8'},
 'oper': 'CREATE',
 'request-id': 'req-15202590-cdc1-417f-92ea-ab2c4aa7beb8',
 'type': 'analytics_alarm_node',
 'uuid': '32150fb8-759a-4a49-ba7e-54e67d5dece8'}
07/28/2025 03:29:56.364 7f752580c978 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001297
07/28/2025 03:29:56.365 7f752580c978 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
07/28/2025 03:29:56.365 7f75257dea20 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
07/28/2025 03:29:56.365 7f75257dea20 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
07/28/2025 03:29:56.365 7f75257dea20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.: 102> in the [ObjectConfigNode:NodeStatusUVE] map
07/28/2025 03:29:56.365 7f75257dea20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.:Config:contrail-device-manager:0: 40> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
07/28/2025 03:30:04.199 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.38',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-2.'],
              'id_perms': {'created': '2025-07-28T03:30:04.182165',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:30:04.182165',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9698533606995796173,
                                    'uuid_mslong': 4349837557235469656}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '3c5dba36-3dac-4d58-8698-1cee372c20cd'},
 'oper': 'CREATE',
 'request-id': 'req-58dad90e-1589-478e-a836-5d735bd70b6f',
 'type': 'analytics_snmp_node',
 'uuid': '3c5dba36-3dac-4d58-8698-1cee372c20cd'}
07/28/2025 03:30:04.633 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.50',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-3.'],
              'id_perms': {'created': '2025-07-28T03:30:04.624368',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:30:04.624368',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10155336785098815604,
                                    'uuid_mslong': 16721521444996334788}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'e80ec728-e915-44c4-8cef-01003245b874'},
 'oper': 'CREATE',
 'request-id': 'req-946a3380-7e6e-49ff-9cbe-d6db1dd21d3a',
 'type': 'analytics_snmp_node',
 'uuid': 'e80ec728-e915-44c4-8cef-01003245b874'}
07/28/2025 03:30:04.707 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3721-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3721-1.'],
              'id_perms': {'created': '2025-07-28T03:30:04.697141',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:30:04.697141',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13805029660525722643,
                                    'uuid_mslong': 18153291479791912104}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'fbed726b-ad1f-44a8-bf95-5155855dfc13'},
 'oper': 'CREATE',
 'request-id': 'req-bff6e10c-a004-48b2-b62d-94fefa122a56',
 'type': 'analytics_snmp_node',
 'uuid': 'fbed726b-ad1f-44a8-bf95-5155855dfc13'}
07/28/2025 03:31:45.848 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-4536cceb-563a-4b4d-8005-a98dd1797388',
 'type': 'global_system_config',
 'uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554'}
07/28/2025 03:31:45.982 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3721-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3721-2'],
              'id_perms': {'created': '2025-07-28T03:31:45.969845',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:31:45.969845',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11265549472964208307,
                                    'uuid_mslong': 9786799183882109378}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '87d1b201-4b60-41c2-9c57-458ee79ee6b3',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-116efcf1-d1ef-4629-806d-96bb94a69426',
 'type': 'virtual_router',
 'uuid': '87d1b201-4b60-41c2-9c57-458ee79ee6b3'}
07/28/2025 03:31:46.338 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3721-2',
                          'vhost0'],
              'id_perms': {'created': '2025-07-28T03:31:46.316274',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:31:46.316274',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12372655542194391432,
                                    'uuid_mslong': 13575376084928840900}},
              'parent_type': 'virtual-router',
              'parent_uuid': '87d1b201-4b60-41c2-9c57-458ee79ee6b3',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'bc656c9f-b284-44c4-abb4-80a998c3c988',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:bc:65:6c:9f:b2']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '3900ff46-b28b-4592-aebc-497937f03da7'}]},
 'oper': 'CREATE',
 'request-id': 'req-df918cff-a98c-4a8c-b329-d99b4d0bfa89',
 'type': 'virtual_machine_interface',
 'uuid': 'bc656c9f-b284-44c4-abb4-80a998c3c988'}
07/28/2025 03:31:46.413 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-df918cff-a98c-4a8c-b329-d99b4d0bfa89',
 'type': 'virtual_machine_interface',
 'uuid': 'bc656c9f-b284-44c4-abb4-80a998c3c988'}
07/28/2025 03:31:46.541 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3721-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3721-1'],
              'id_perms': {'created': '2025-07-28T03:31:46.525234',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:31:46.525234',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11742593905386954116,
                                    'uuid_mslong': 3600027525017649302}},
              'parent_type': 'global-system-config',
              'parent_uuid': 'e8ca34b4-32a1-4983-96ed-8b8ff9f73554',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '31f5ddf5-d24e-4096-a2f6-12f128419d84',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-fe037010-1c7c-471f-a72d-2c039398e1f7',
 'type': 'virtual_router',
 'uuid': '31f5ddf5-d24e-4096-a2f6-12f128419d84'}
07/28/2025 03:31:46.893 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-168fcdaf-b9af-41bb-91cf-dba49add061c',
 'type': 'access_control_list',
 'uuid': '3c61a43b-3cdd-4992-9705-4707de3b5b8c'}
07/28/2025 03:31:46.916 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3721-1',
                          'vhost0'],
              'id_perms': {'created': '2025-07-28T03:31:46.883053',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-07-28T03:31:46.883053',
                           'permissions': {'group': 'admin',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11976873404390247177,
                                    'uuid_mslong': 3942386092429757067}},
              'parent_type': 'virtual-router',
              'parent_uuid': '31f5ddf5-d24e-4096-a2f6-12f128419d84',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '36b62b43-6eb7-4a8b-a636-66e7b4810b09',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:36:b6:2b:43:6e']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '3900ff46-b28b-4592-aebc-497937f03da7'}]},
 'oper': 'CREATE',
 'request-id': 'req-fd487ff1-798f-4a0c-a361-a0d9d19f33fe',
 'type': 'virtual_machine_interface',
 'uuid': '36b62b43-6eb7-4a8b-a636-66e7b4810b09'}
07/28/2025 03:31:46.982 7f752580ce10 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3721-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-fd487ff1-798f-4a0c-a361-a0d9d19f33fe',
 'type': 'virtual_machine_interface',
 'uuid': '36b62b43-6eb7-4a8b-a636-66e7b4810b09'}
07/28/2025 03:32:12.372 7f752c7e6c18 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.: 102> in the [ObjectConfigNode:NodeStatusUVE] map
07/28/2025 03:32:42.558 7f75279e9a20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.: 102> in the [ObjectConfigNode:NodeStatusUVE] map
07/28/2025 03:34:23.965 7f7525816780 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3721-2.: 102> in the [ObjectConfigNode:NodeStatusUVE] map