04/28/2025 00:41:56.814 7f8af1120e48 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0]
04/28/2025 00:41:56.814 7f8af1120e48 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False]
04/28/2025 00:41:56.814 7f8af1120e48 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False]
04/28/2025 00:41:56.814 7f8ae88262e8 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none]
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3229-2., 1> in the [ObjectConfigNode:NodeStatusUVE] map
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [DEBUG]: Add uve <cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0, 1> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle]
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.815 7f8ae88262e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.816 7f8ae88262e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1745800916815317  collector_name =   collector_ip =   collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 1  >>  
04/28/2025 00:41:56.816 7f8ae88262e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.859 7f8af1120e48 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//']
04/28/2025 00:41:56.867 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.867 7f8ae8777588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.871 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8728668>
04/28/2025 00:41:56.871 7f8ae8777240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.871 7f8ae8777240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
04/28/2025 00:41:56.871 7f8ae8777240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.898 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
04/28/2025 00:41:56.903 7f8ae87770f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.903 7f8ae87770f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Down  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.903 7f8ae87770f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.906 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8780fd0>
04/28/2025 00:41:56.906 7f8ae8777240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.906 7f8ae8777240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart] connection down  >>,  ]  >>  
04/28/2025 00:41:56.906 7f8ae8777240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.921 7f8af1120e48 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run
04/28/2025 00:41:56.922 7f8af1120e48 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
04/28/2025 00:41:56.922 7f8af1120e48 [contrail-device-manager] [WARNING]: initializing cassandra cluster
04/28/2025 00:41:56.922 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
04/28/2025 00:41:56.922 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet
04/28/2025 00:41:56.922 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
04/28/2025 00:41:56.923 7f8aeafbf978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet
04/28/2025 00:41:56.923 7f8aeafbf978 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection
04/28/2025 00:41:56.923 7f8ae8612588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.923 7f8ae8612588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.923 7f8ae8612588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.924 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
04/28/2025 00:41:56.927 7f8aee0b06d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8617438>
04/28/2025 00:41:56.927 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer
04/28/2025 00:41:56.927 7f8aeafbf978 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8617438>
04/28/2025 00:41:56.968 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
04/28/2025 00:41:56.969 7f8ae8571438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.969 7f8ae8571438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.969 7f8ae8571438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.976 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
04/28/2025 00:41:56.976 7f8ae8564a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:56.976 7f8ae8564a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ ,  ]  status = Down  description = none to Idle on EvStart  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:41:56.976 7f8ae8564a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:41:57.984 7f8af1120e48 [contrail-device-manager] [WARNING]: Waiting for keyspace config_db_uuid to be created
04/28/2025 00:41:57.991 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
04/28/2025 00:41:58.021 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
04/28/2025 00:41:59.181 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:00.591 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_uuid_table', created
04/28/2025 00:42:00.596 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:00.815 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:00.816 7f8ae84e1cc0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:00.816 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:00.816 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:00.817 7f8ae84e1cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:02.062 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:03.137 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:42:03.142 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:04.818 7f8ae8514e10 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:04.819 7f8ae8514e10 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:04.820 7f8ae8514e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:05.649 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:06.207 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table', created
04/28/2025 00:42:06.215 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:08.243 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:08.820 7f8ae84e1f60 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:08.821 7f8ae84e1f60 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:08.821 7f8ae84e1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:08.821 7f8ae84e1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:08.821 7f8ae84e1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:08.821 7f8ae84e1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:08.822 7f8ae84e1f60 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:08.823 7f8ae84e1f60 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:08.823 7f8ae84e1f60 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:09.153 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:42:09.158 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:11.627 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:11.628 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_shared_table', created
04/28/2025 00:42:11.631 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:12.823 7f8aede07048 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:12.824 7f8aede07048 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:12.826 7f8aede07048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:12.826 7f8aede07048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:12.826 7f8aede07048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:12.826 7f8aede07048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:12.826 7f8aede07048 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:12.827 7f8aede07048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:12.828 7f8aede07048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:13.136 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:42:14.055 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:42:14.060 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:42:14.061 7f8ae84de978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.061 7f8ae84de978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:14.061 7f8ae84de978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.091 7f8af1120e48 [contrail-device-manager] [ERROR]: Error in db walk read 'type'
04/28/2025 00:42:14.092 7f8ae84930f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.092 7f8ae84930f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Initializing  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
04/28/2025 00:42:14.092 7f8ae84930f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.101 7f8ae8499630 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.101 7f8ae8499630 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:14.102 7f8ae8499630 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:14.102 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy
04/28/2025 00:42:14.102 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer
04/28/2025 00:42:14.102 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
04/28/2025 00:42:14.102 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3229-2.
04/28/2025 00:42:14.106 7f8aee0b06d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8617438>
04/28/2025 00:42:14.187 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3229-2.']
04/28/2025 00:42:14.222 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
04/28/2025 00:42:14.227 7f8aee0b06d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8617438>
04/28/2025 00:42:14.297 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3229-2.']
04/28/2025 00:42:14.612 7f8af1120e48 [contrail-device-manager] [DEBUG]: Fetching all containers
04/28/2025 00:42:14.647 7f8af1120e48 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1
04/28/2025 00:42:14.786 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3229-2..config_queue
04/28/2025 00:42:14.786 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3229-2..tftp_queue
04/28/2025 00:42:15.287 7f8af1120e48 [contrail-device-manager] [WARNING]: Process 138 prepared to run in Full mode...
04/28/2025 00:42:15.288 7f8af1120e48 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 
04/28/2025 00:42:15.288 7f8af1120e48 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096
04/28/2025 00:42:15.290 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page
04/28/2025 00:42:15.290 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq]
04/28/2025 00:42:15.291 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page
04/28/2025 00:42:15.291 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq]
04/28/2025 00:42:15.292 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page
04/28/2025 00:42:15.292 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq]
04/28/2025 00:42:15.295 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList]
04/28/2025 00:42:15.296 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList]
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest]
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest]
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest]
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer]
04/28/2025 00:42:15.298 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient]
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest]
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest]
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq]
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq]
04/28/2025 00:42:15.299 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus]
04/28/2025 00:42:15.300 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet]
04/28/2025 00:42:15.301 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus]
04/28/2025 00:42:15.301 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest]
04/28/2025 00:42:15.301 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq]
04/28/2025 00:42:15.301 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq]
04/28/2025 00:42:15.301 7f8af1120e48 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq]
04/28/2025 00:42:15.303 7f8af1120e48 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue
04/28/2025 00:42:15.315 7f8ae8413d68 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port
04/28/2025 00:42:15.315 7f8ae8413d68 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096
04/28/2025 00:42:15.357 7f8ae80f3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:15.357 7f8ae80f3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Initializing  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:15.357 7f8ae80f3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:15.369 7f8ae80f3c18 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:15.370 7f8ae80f3c18 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:15.370 7f8ae80f3c18 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:15.376 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection
04/28/2025 00:42:15.380 7f8aee0b06d8 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8617438>
04/28/2025 00:42:15.495 7f8aee0b06d8 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3229-2.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3229-2..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3229-2..tftp_queue', 'device_manager_ztp.ztp_queue']
04/28/2025 00:42:16.825 7f8ae32d42e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:16.826 7f8ae32d42e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:16.827 7f8ae32d42e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:16.828 7f8ae32d42e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:16.828 7f8ae32d42e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:20.827 7f8ae320f240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:20.828 7f8ae320f240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:20.828 7f8ae320f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Down  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer Connection State updated] connection down  >>,  ]  >>  
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:20.829 7f8ae320f240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:20.830 7f8ae320f240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:21.484 7f8ae320c438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:21.484 7f8ae320c438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:21.484 7f8ae320c438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:24.829 7f8ae3201438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:24.830 7f8ae3201438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:24.831 7f8ae3201438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:24.831 7f8ae3201438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:24.831 7f8ae3201438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:24.832 7f8ae3201438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:24.832 7f8ae3201438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:28.831 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:28.832 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:28.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:28.834 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:28.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:32.833 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:32.834 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:32.835 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:32.835 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:32.835 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:32.835 7f8ae32ca2e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:32.835 7f8ae32ca2e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:36.835 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:36.836 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:36.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:40.837 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:40.838 7f8ae32caa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:40.838 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:40.838 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:40.839 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:44.838 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:44.840 7f8ae32caa20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:44.841 7f8ae32caa20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:48.841 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:48.842 7f8ae32944e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:48.842 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:48.842 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:48.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:52.843 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:52.844 7f8ae32944e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:52.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:52.846 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:52.846 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:56.845 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:42:56.846 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:42:56.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:00.847 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:00.848 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:00.849 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:00.849 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:00.849 7f8ae32944e0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:00.849 7f8ae32944e0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:00.849 7f8ae32944e0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:04.848 7f8ae31996d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:04.849 7f8ae31996d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:04.850 7f8ae31996d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:08.850 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:08.850 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:08.851 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:08.852 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:12.851 7f8ae3203588 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:12.852 7f8ae3203588 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:12.853 7f8ae3203588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:12.854 7f8ae3203588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:12.854 7f8ae3203588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:12.854 7f8ae3203588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:12.854 7f8ae3203588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:12.854 7f8ae3203588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:16.853 7f8ae8527ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:16.854 7f8ae8527ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:16.855 7f8ae8527ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:20.855 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:20.855 7f8ae84aa8d0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:20.856 7f8ae84aa8d0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:20.857 7f8ae84aa8d0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:24.856 7f8aee277438 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:24.857 7f8aee277438 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:24.858 7f8aee277438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:24.859 7f8aee277438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:24.859 7f8aee277438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:24.859 7f8aee277438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:28.858 7f8ae3203240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:28.859 7f8ae3203240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:28.860 7f8ae3203240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:28.861 7f8ae3203240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:28.861 7f8ae3203240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:32.860 7f8ae8499240 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:32.861 7f8ae8499240 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:32.862 7f8ae8499240 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:32.863 7f8ae8499240 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:32.863 7f8ae8499240 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.522 7f8af1120e48 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql
04/28/2025 00:43:33.522 7f8af1120e48 [contrail-device-manager] [WARNING]: initializing cassandra cluster
04/28/2025 00:43:33.523 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create
04/28/2025 00:43:33.523 7f8ae329bd68 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.523 7f8ae329bd68 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:33.523 7f8ae329bd68 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.524 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created
04/28/2025 00:43:33.551 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected
04/28/2025 00:43:33.552 7f8ae32b3e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.552 7f8ae32b3e10 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Initializing  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down  >>,  ]  >>  
04/28/2025 00:43:33.552 7f8ae32b3e10 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.558 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS
04/28/2025 00:43:33.558 7f8ae32b3cc0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.559 7f8ae32b3cc0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:33.559 7f8ae32b3cc0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:33.569 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:34.645 7f8af1120e48 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace', created
04/28/2025 00:43:34.650 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:34.657 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:35.103 7f8af1120e48 [contrail-device-manager] [WARNING]: keyspace 'dm_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None}
04/28/2025 00:43:35.108 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:35.108 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready
04/28/2025 00:43:35.162 7f8af1120e48 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready
04/28/2025 00:43:35.170 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:36.113 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table', created
04/28/2025 00:43:36.117 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:36.122 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:36.862 7f8ae315c0f0 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:36.863 7f8ae315c0f0 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:36.863 7f8ae315c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:36.863 7f8ae315c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:36.863 7f8ae315c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:36.863 7f8ae315c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:36.864 7f8ae315c0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:37.041 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pr_vn_ip_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:43:37.046 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:37.051 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:37.766 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table', created
04/28/2025 00:43:37.773 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:37.781 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:39.201 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pr_asn_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:43:39.206 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:39.215 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:40.198 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table', created
04/28/2025 00:43:40.202 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:40.208 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:40.864 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:40.865 7f8ae31dd6d8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:40.865 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:40.865 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Initializing  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down  >>,  ]  >>  
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:40.866 7f8ae31dd6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:41.093 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_ni_ipv6_ll_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:43:41.097 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:41.104 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:42.253 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table', created
04/28/2025 00:43:42.272 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:42.282 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock acquired. Performing schema change...
04/28/2025 00:43:42.758 7f8af1120e48 [contrail-device-manager] [WARNING]: table 'dm_pnf_resource_table' fixed with properties {'gc_grace_seconds': 864000}
04/28/2025 00:43:42.763 7f8af1120e48 [contrail-device-manager] [WARNING]: Zookeeper lock released.
04/28/2025 00:43:42.763 7f8aecd6d0f0 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.763 7f8aecd6d0f0 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:42.763 7f8aecd6d0f0 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.839 7f8af1120e48 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.41:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//']
04/28/2025 00:43:42.840 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down
04/28/2025 00:43:42.840 7f8ae8013198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.840 7f8ae8013198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Initializing  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:43:42.840 7f8ae8013198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.840 7f8ae8013198 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.840 7f8ae8013198 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:43:42.841 7f8ae8013198 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.844 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae8616dd8>
04/28/2025 00:43:42.844 7f8ae315c828 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.844 7f8ae315c828 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:42.844 7f8ae315c828 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.886 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
04/28/2025 00:43:42.886 7f8ae3158390 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.886 7f8ae3158390 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:43:42.886 7f8ae3158390 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.894 7f8af1120e48 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae311be10>
04/28/2025 00:43:42.895 7f8ae3158438 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.895 7f8ae3158438 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:42.895 7f8ae3158438 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.896 7f8ae315c198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down
04/28/2025 00:43:42.896 7f8ae800e6d8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.897 7f8ae800e6d8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Down  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down  >>,  ]  >>  
04/28/2025 00:43:42.897 7f8ae800e6d8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.914 7f8ae315c198 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED <Connection: amqp://guest:**@10.0.0.41:5673// at 0x7f8ae311be10>
04/28/2025 00:43:42.915 7f8ae329bb70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:42.915 7f8ae329bb70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:42.915 7f8ae329bb70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:44.185 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
              'id_perms': {'created': '2025-04-28T00:43:44.155008',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:43:44.155008',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12380245541936381256,
                                    'uuid_mslong': 1473429597800450849}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '1472ac69-a271-4b21-abcf-77ba1f3b3d48'},
 'oper': 'CREATE',
 'request-id': 'req-70bd8f20-65c5-4b01-899e-83bedd475357',
 'type': 'database_node',
 'uuid': '1472ac69-a271-4b21-abcf-77ba1f3b3d48'}
04/28/2025 00:43:44.260 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
              'id_perms': {'created': '2025-04-28T00:43:44.240700',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:43:44.240700',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9461567533914809128,
                                    'uuid_mslong': 16190685390571128538}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'e0b0de94-af19-46da-834e-3d8ae55c6328'},
 'oper': 'CREATE',
 'request-id': 'req-a29146f9-8abe-4e57-9149-0701ea4e9a2b',
 'type': 'database_node',
 'uuid': 'e0b0de94-af19-46da-834e-3d8ae55c6328'}
04/28/2025 00:43:44.735 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
 'obj_dict': {'database_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
              'id_perms': {'created': '2025-04-28T00:43:44.726569',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:43:44.726569',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11044383649665018368,
                                    'uuid_mslong': 4078663711732156007}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '389a5309-4012-4667-9945-8869e96a6a00'},
 'oper': 'CREATE',
 'request-id': 'req-d882fe0f-f91b-4af2-8b52-bf426633884d',
 'type': 'database_node',
 'uuid': '389a5309-4012-4667-9945-8869e96a6a00'}
04/28/2025 00:43:44.866 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:44.867 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:44.868 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:44.868 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:44.868 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:44.868 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:48.868 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:48.869 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:48.870 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:52.870 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:52.871 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:52.871 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:52.871 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:52.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:56.872 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:43:56.873 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:43:56.873 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:43:56.873 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:56.873 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:43:56.873 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:43:56.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:00.874 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:44:00.875 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:44:00.875 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:44:00.875 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:00.875 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:44:00.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:04.876 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:44:04.877 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:44:04.877 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:44:04.877 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.23:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:44:04.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:08.878 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:44:08.879 7f8ae3199ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail
04/28/2025 00:44:08.879 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:44:08.879 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.27:8086,  ]  status = Down  description = Connect to Idle on EvTcpConnectFail  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down  >>,  ]  >>  
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 0  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.27:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:44:08.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:12.880 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [INFO]: Session Event: TCP Connected
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:12.881 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
04/28/2025 00:44:12.882 7f8ae3199ac8 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
04/28/2025 00:44:12.882 7f8ae3199ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
04/28/2025 00:44:12.882 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
04/28/2025 00:44:12.882 7f8ae3199ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
04/28/2025 00:44:12.882 7f8ae3158b70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
04/28/2025 00:44:12.883 7f8ae3158b70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
04/28/2025 00:44:13.635 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
              'id_perms': {'created': '2025-04-28T00:44:13.629387',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:13.629387',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13670127691287107880,
                                    'uuid_mslong': 6027548385558939854}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '53a62752-43b8-48ce-bdb6-0cb531661928'},
 'oper': 'CREATE',
 'request-id': 'req-b6ba7f7b-71a5-4181-b609-ffbb4d78b3e4',
 'type': 'analytics_node',
 'uuid': '53a62752-43b8-48ce-bdb6-0cb531661928'}
04/28/2025 00:44:14.003 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
              'id_perms': {'created': '2025-04-28T00:44:13.987430',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:13.987430',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12968754496800194510,
                                    'uuid_mslong': 8261257667789406684}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '72a5e214-2e8f-41dc-b3fa-4580e1067fce'},
 'oper': 'CREATE',
 'request-id': 'req-43014f26-1e41-4421-ad8a-2840b953520d',
 'type': 'analytics_node',
 'uuid': '72a5e214-2e8f-41dc-b3fa-4580e1067fce'}
04/28/2025 00:44:14.052 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
 'obj_dict': {'analytics_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
              'id_perms': {'created': '2025-04-28T00:44:14.044771',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:14.044771',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10933582033587858792,
                                    'uuid_mslong': 11768253246988503344}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'a3513bfa-2d96-4930-97bb-e2ee5298ed68'},
 'oper': 'CREATE',
 'request-id': 'req-f54247b1-3459-47db-ba12-01a269726483',
 'type': 'analytics_node',
 'uuid': 'a3513bfa-2d96-4930-97bb-e2ee5298ed68'}
04/28/2025 00:44:24.040 7f8ae3158588 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed
04/28/2025 00:44:24.040 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit]
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle]
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.41:8086,  ]  status = Down  description = ClientInit to Idle on EvTcpClose  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[ClientInit to Idle on EvTcpClose] connection down  >>,  ]  >>  
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0  client_info = <<  status = Idle  successful_connections = 1  pid = 138  http_port = 8096  start_time = 1745800916815317  collector_name =   collector_ip = 10.0.0.41:8086  collector_list = [ 10.0.0.41:8086, 10.0.0.23:8086, 10.0.0.27:8086,  ]  >>  sm_queue_count = 1  max_sm_queue_count = 2  >>  
04/28/2025 00:44:24.041 7f8aee2d7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle]
04/28/2025 00:44:28.042 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle]
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [INFO]: Session Event: TCP Connected
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect]
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = <<  name = cn-jenkins-deploy-platform-ansible-os-3229-2.  process_status = [ <<  module_id = contrail-device-manager  instance_id = 0  state = Non-Functional  connection_infos = [ <<  type = Collector  name = Collector  server_addrs = [ 10.0.0.23:8086,  ]  status = Initializing  description = Idle to Connect on EvIdleHoldTimerExpired  >>, <<  type = Database  name = RabbitMQ  server_addrs = [ 10.0.0.41:5673, 10.0.0.27:5673, 10.0.0.23:5673,  ]  status = Up  description =   >>, <<  type = Database  name = Cassandra  server_addrs = [ 10.0.0.41:9041, 10.0.0.27:9041, 10.0.0.23:9041,  ]  status = Up  description =   >>, <<  type = Zookeeper  name = Zookeeper  server_addrs = [ 10.0.0.41:2181, 10.0.0.27:2181, 10.0.0.23:2181,  ]  status = Up  description =   >>, <<  type = ApiServer  name = ApiServer  server_addrs = [ 10.0.0.41,10.0.0.27,10.0.0.23:8082,  ]  status = Up  description = ApiServer Connection State updated  >>,  ]  description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down  >>,  ]  >>  
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect]
04/28/2025 00:44:28.043 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect]
04/28/2025 00:44:28.044 7f8aee2d7a20 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19
04/28/2025 00:44:28.044 7f8aee2d7a20 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit]
04/28/2025 00:44:28.044 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
04/28/2025 00:44:28.044 7f8aee2d7a20 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit]
04/28/2025 00:44:28.044 7f8ae3169630 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
04/28/2025 00:44:28.045 7f8ae3169630 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
04/28/2025 00:44:28.049 7f8ae9442cc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017
04/28/2025 00:44:28.049 7f8ae9442cc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
04/28/2025 00:44:28.049 7f8ae315b240 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit]
04/28/2025 00:44:28.050 7f8ae315b240 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0
04/28/2025 00:44:28.050 7f8ae315b240 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.: 97> in the [ObjectConfigNode:NodeStatusUVE] map
04/28/2025 00:44:28.050 7f8ae315b240 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0: 37> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
04/28/2025 00:44:28.050 7f8ae315b240 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established]
04/28/2025 00:44:28.050 7f8ae3169630 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG]
04/28/2025 00:44:28.051 7f8ae3169630 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID]
04/28/2025 00:44:29.065 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
              'id_perms': {'created': '2025-04-28T00:44:29.053922',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:29.053922',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9256672403010357112,
                                    'uuid_mslong': 11224545999365817113}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '9bc5991d-c13b-4319-8076-4e81af980778'},
 'oper': 'CREATE',
 'request-id': 'req-28bd5da8-a94f-4523-9bcd-171fa9e1e3b1',
 'type': 'analytics_alarm_node',
 'uuid': '9bc5991d-c13b-4319-8076-4e81af980778'}
04/28/2025 00:44:29.649 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
              'id_perms': {'created': '2025-04-28T00:44:29.635317',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:29.635317',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12231708269389116893,
                                    'uuid_mslong': 10026963362068121302}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '8b26ee0d-7bed-46d6-a9bf-c1dd592575dd'},
 'oper': 'CREATE',
 'request-id': 'req-c79e4076-b1ff-43fe-b7d0-bf836640c706',
 'type': 'analytics_alarm_node',
 'uuid': '8b26ee0d-7bed-46d6-a9bf-c1dd592575dd'}
04/28/2025 00:44:29.727 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
              'id_perms': {'created': '2025-04-28T00:44:29.711421',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:29.711421',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10655927022203056204,
                                    'uuid_mslong': 13139657493199209606}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'b65970df-8870-4486-93e1-752b4ee6304c'},
 'oper': 'CREATE',
 'request-id': 'req-bb945806-50d7-4553-b159-1899e10d208d',
 'type': 'analytics_alarm_node',
 'uuid': 'b65970df-8870-4486-93e1-752b4ee6304c'}
04/28/2025 00:44:33.151 7f8ae9442cc0 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001296
04/28/2025 00:44:33.152 7f8ae9442cc0 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient]
04/28/2025 00:44:33.152 7f8ae8527e10 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established]
04/28/2025 00:44:33.152 7f8ae8527e10 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 2
04/28/2025 00:44:33.152 7f8ae8527e10 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.: 98> in the [ObjectConfigNode:NodeStatusUVE] map
04/28/2025 00:44:33.152 7f8ae8527e10 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.:Config:contrail-device-manager:0: 38> in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map
04/28/2025 00:44:38.957 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.27',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-2.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-2.'],
              'id_perms': {'created': '2025-04-28T00:44:38.942266',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:38.942266',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10989454722676779061,
                                    'uuid_mslong': 5894447413106854512}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '51cd48b1-2d74-4a70-9882-62d87c636835'},
 'oper': 'CREATE',
 'request-id': 'req-0f2b8596-ce7a-491a-b899-92e14d6b7ebf',
 'type': 'analytics_snmp_node',
 'uuid': '51cd48b1-2d74-4a70-9882-62d87c636835'}
04/28/2025 00:44:39.668 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.23',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-3.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-3.'],
              'id_perms': {'created': '2025-04-28T00:44:39.648413',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:39.648413',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 10681562353434212328,
                                    'uuid_mslong': 11015972895807786120}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '98e098fb-cdf4-4c88-943c-885dfaa1b7e8'},
 'oper': 'CREATE',
 'request-id': 'req-6f76a577-5090-4cad-b793-7b170a735117',
 'type': 'analytics_snmp_node',
 'uuid': '98e098fb-cdf4-4c88-943c-885dfaa1b7e8'}
04/28/2025 00:44:39.694 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.41',
              'display_name': 'cn-jenkins-deploy-platform-ansible-os-3229-1.',
              'fq_name': ['default-global-system-config',
                          'cn-jenkins-deploy-platform-ansible-os-3229-1.'],
              'id_perms': {'created': '2025-04-28T00:44:39.685263',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:44:39.685263',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 13574130788264450608,
                                    'uuid_mslong': 11554262184844412775}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'a058fc3d-7161-4767-bc61-000879321a30'},
 'oper': 'CREATE',
 'request-id': 'req-14f27df0-6ef4-4e87-9c70-03138ee39c26',
 'type': 'analytics_snmp_node',
 'uuid': 'a058fc3d-7161-4767-bc61-000879321a30'}
04/28/2025 00:46:20.913 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-114c7a59-d633-4d10-80cc-73428a0c6bf4',
 'type': 'global_system_config',
 'uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9'}
04/28/2025 00:46:21.005 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'],
 'oper': 'UPDATE',
 'request-id': 'req-3014e48f-05d5-4566-8b2f-775cbbbf0752',
 'type': 'global_system_config',
 'uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9'}
04/28/2025 00:46:21.067 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-1'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3229-1',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3229-1'],
              'id_perms': {'created': '2025-04-28T00:46:21.053339',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:46:21.053339',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12478124612223341143,
                                    'uuid_mslong': 2040194546694244631}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '1c503a21-7c66-4917-ad2b-34390ea19257',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.25'},
 'oper': 'CREATE',
 'request-id': 'req-d7b6b0f0-b9ef-4bd0-afce-9c3b42990c1b',
 'type': 'virtual_router',
 'uuid': '1c503a21-7c66-4917-ad2b-34390ea19257'}
04/28/2025 00:46:21.128 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-2'],
 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-3229-2',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3229-2'],
              'id_perms': {'created': '2025-04-28T00:46:21.116855',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:46:21.116855',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 12983212385688539021,
                                    'uuid_mslong': 15000937214933877453}},
              'parent_type': 'global-system-config',
              'parent_uuid': '52f1cfc6-a0d5-42db-9983-8a6c038986d9',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': 'd02e08eb-2a12-42cd-b42d-a2e0746acf8d',
              'virtual_router_dpdk_enabled': False,
              'virtual_router_ip_address': '10.20.0.193'},
 'oper': 'CREATE',
 'request-id': 'req-3485ff34-a0b0-4fe1-b373-7758bd1f3272',
 'type': 'virtual_router',
 'uuid': 'd02e08eb-2a12-42cd-b42d-a2e0746acf8d'}
04/28/2025 00:46:21.413 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-1',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3229-1',
                          'vhost0'],
              'id_perms': {'created': '2025-04-28T00:46:21.401286',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:46:21.401286',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 9279265284373818547,
                                    'uuid_mslong': 11193129772356421463}},
              'parent_type': 'virtual-router',
              'parent_uuid': '1c503a21-7c66-4917-ad2b-34390ea19257',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '9b55fc39-6627-4757-80c6-929ccbb72cb3',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:9b:55:fc:39:66']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '415935cf-eb39-407a-b79f-403ea2fd24a5'}]},
 'oper': 'CREATE',
 'request-id': 'req-66f44f08-9bb7-4e6b-8b4b-c347462a6e11',
 'type': 'virtual_machine_interface',
 'uuid': '9b55fc39-6627-4757-80c6-929ccbb72cb3'}
04/28/2025 00:46:21.454 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-1',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-66f44f08-9bb7-4e6b-8b4b-c347462a6e11',
 'type': 'virtual_machine_interface',
 'uuid': '9b55fc39-6627-4757-80c6-929ccbb72cb3'}
04/28/2025 00:46:21.483 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-2',
             'vhost0'],
 'obj_dict': {'display_name': 'vhost0',
              'fq_name': ['default-global-system-config',
                          'an-jenkins-deploy-platform-ansible-os-3229-2',
                          'vhost0'],
              'id_perms': {'created': '2025-04-28T00:46:21.468932',
                           'creator': None,
                           'description': None,
                           'enable': True,
                           'last_modified': '2025-04-28T00:46:21.468932',
                           'permissions': {'group': 'member',
                                           'group_access': 7,
                                           'other_access': 7,
                                           'owner': 'admin',
                                           'owner_access': 7},
                           'user_visible': True,
                           'uuid': {'uuid_lslong': 11832552897525502804,
                                    'uuid_mslong': 1502122864455075150}},
              'parent_type': 'virtual-router',
              'parent_uuid': 'd02e08eb-2a12-42cd-b42d-a2e0746acf8d',
              'perms2': {'global_access': 0,
                         'owner': 'cloud-admin',
                         'owner_access': 7,
                         'share': []},
              'uuid': '14d89cc9-60d6-454e-a435-ac2b3306d354',
              'virtual_machine_interface_disable_policy': True,
              'virtual_machine_interface_mac_addresses': {'mac_address': ['02:14:d8:9c:c9:60']},
              'virtual_network_refs': [{'to': ['default-domain',
                                               'default-project',
                                               'ip-fabric'],
                                        'uuid': '415935cf-eb39-407a-b79f-403ea2fd24a5'}]},
 'oper': 'CREATE',
 'request-id': 'req-af19725e-2cdb-49a4-abf6-b532e669fee5',
 'type': 'virtual_machine_interface',
 'uuid': '14d89cc9-60d6-454e-a435-ac2b3306d354'}
04/28/2025 00:46:21.552 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config',
             'an-jenkins-deploy-platform-ansible-os-3229-2',
             'vhost0'],
 'oper': 'UPDATE',
 'request-id': 'req-af19725e-2cdb-49a4-abf6-b532e669fee5',
 'type': 'virtual_machine_interface',
 'uuid': '14d89cc9-60d6-454e-a435-ac2b3306d354'}
04/28/2025 00:46:21.951 7f8ae3158f60 [contrail-device-manager] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'],
 'oper': 'UPDATE',
 'request-id': 'req-01635f53-9bf1-4610-8921-b7ebc45d51e7',
 'type': 'access_control_list',
 'uuid': '820a60cb-3ed3-4fef-bfd2-eba65bab8489'}
04/28/2025 00:46:53.492 7f8ae9495a20 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.: 98> in the [ObjectConfigNode:NodeStatusUVE] map
04/28/2025 00:47:20.674 7f8ae315b978 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.: 98> in the [ObjectConfigNode:NodeStatusUVE] map
04/28/2025 01:33:49.707 7f8ae943d828 [contrail-device-manager] [DEBUG]: send sync_uve <cn-jenkins-deploy-platform-ansible-os-3229-2.: 98> in the [ObjectConfigNode:NodeStatusUVE] map