03/23/2026 05:43:16.105 7fbc03664588 [contrail-device-manager] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/23/2026 05:43:16.106 7fbc03664588 [contrail-device-manager] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/23/2026 05:43:16.106 7fbc03664588 [contrail-device-manager] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/23/2026 05:43:16.106 7fbbfadb3048 [contrail-device-manager] [INFO]: Processing event[EvStart] in state[none] 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.107 7fbbfadb3048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.108 7fbbfadb3048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 0 pid = 135 start_time = 1774244596107438 collector_name = collector_ip = collector_list = [ 10.0.0.50:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 03/23/2026 05:43:16.108 7fbbfadb3048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.188 7fbc03664588 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//'] 03/23/2026 05:43:16.199 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/23/2026 05:43:16.199 7fbbface92e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.204 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/23/2026 05:43:16.214 7fbbface92e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.214 7fbbface92e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/23/2026 05:43:16.214 7fbbface92e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.376 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/23/2026 05:43:16.376 7fbbface92e8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.377 7fbbface92e8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/23/2026 05:43:16.377 7fbbface92e8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.380 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/23/2026 05:43:16.380 7fbc095b4978 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.380 7fbc095b4978 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/23/2026 05:43:16.381 7fbc095b4978 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.405 7fbc03664588 [contrail-device-manager] [DEBUG]: Removed remaining AMQP queue from previous run 03/23/2026 05:43:16.405 7fbc03664588 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/23/2026 05:43:16.405 7fbc03664588 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/23/2026 05:43:16.406 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/23/2026 05:43:16.406 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting consumer greenlet 03/23/2026 05:43:16.406 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/23/2026 05:43:16.406 7fbbfacc5438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Starting publisher greenlet 03/23/2026 05:43:16.406 7fbbfacc5438 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Publisher connection 03/23/2026 05:43:16.407 7fbbfaba2048 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.407 7fbbfaba2048 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/23/2026 05:43:16.407 7fbbfaba2048 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.409 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/23/2026 05:43:16.420 7fbbfacc5438 [contrail-device-manager] [INFO]: KombuAmqpClient: Publisher connection established 03/23/2026 05:43:16.421 7fbc0950e630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/23/2026 05:43:16.421 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Waiting for consumer 03/23/2026 05:43:16.504 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/23/2026 05:43:16.507 7fbbf9a54588 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:16.508 7fbbf9a54588 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:16.508 7fbbf9a54588 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:20.108 7fbc03714780 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/23/2026 05:43:20.109 7fbc03714780 [contrail-device-manager] [INFO]: Session Event: TCP Connected 03/23/2026 05:43:20.109 7fbc03714780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/23/2026 05:43:20.109 7fbc03714780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:20.110 7fbc03714780 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:20.110 7fbc03714780 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:20.110 7fbc03714780 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/23/2026 05:43:20.110 7fbc03714780 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 03/23/2026 05:43:20.110 7fbc03714780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/23/2026 05:43:20.111 7fbc03714780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/23/2026 05:43:20.111 7fbc03714780 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/23/2026 05:43:20.111 7fbbfab6e438 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/23/2026 05:43:20.112 7fbbfab6e438 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/23/2026 05:43:24.752 7fbbfadbbd68 [contrail-device-manager] [ERROR]: Session Event: TCP Connection Closed 03/23/2026 05:43:24.752 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpClose] in state[ClientInit] 03/23/2026 05:43:24.753 7fbbfb964ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpClose] => State[ClientInit] -> State[Idle] 03/23/2026 05:43:24.753 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:24.753 7fbbfb964ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.50:8086, ] status = Down description = ClientInit to Idle on EvTcpClose >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[ClientInit to Idle on EvTcpClose], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:24.753 7fbbfb964ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:24.753 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:24.754 7fbbfb964ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 1 pid = 135 start_time = 1774244596107438 collector_name = collector_ip = 10.0.0.50:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/23/2026 05:43:24.754 7fbbfb964ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:28.753 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/23/2026 05:43:28.754 7fbbfb964ac8 [contrail-device-manager] [ERROR]: Session Event: TCP Connect Fail 03/23/2026 05:43:28.754 7fbbfb964ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/23/2026 05:43:28.754 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:28.754 7fbbfb964ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:28.754 7fbbfb964ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.33:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1.:Config:contrail-device-manager:0 client_info = << status = Idle successful_connections = 1 pid = 135 start_time = 1774244596107438 collector_name = collector_ip = 10.0.0.33:8086 collector_list = [ 10.0.0.50:8086, 10.0.0.33:8086, 10.0.0.38:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 03/23/2026 05:43:28.755 7fbbfb964ac8 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/23/2026 05:43:31.585 7fbc03664588 [contrail-device-manager] [ERROR]: Error while initializing db connection, retrying: module 'gevent._gevent_cevent' has no attribute 'Timeout' 03/23/2026 05:43:32.755 7fbbf9a54b70 [contrail-device-manager] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [INFO]: Session Event: TCP Connected 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-5515-1. process_status = [ << module_id = contrail-device-manager instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.38:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.38:5673, 10.0.0.50:5673, 10.0.0.33:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.38:9041, 10.0.0.50:9041, 10.0.0.33:9041, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.38:2181, 10.0.0.50:2181, 10.0.0.33:2181, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[], Zookeeper:Zookeeper[] connection down >>, ] >> 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/23/2026 05:43:32.756 7fbbf9a54b70 [contrail-device-manager] [DEBUG]: Send sandesh control message. uve type count # 19 03/23/2026 05:43:32.757 7fbbf9a54b70 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/23/2026 05:43:32.757 7fbbf9a54b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/23/2026 05:43:32.757 7fbbf9a54b70 [contrail-device-manager] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/23/2026 05:43:32.757 7fbbfaba24e0 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/23/2026 05:43:32.757 7fbbfaba24e0 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/23/2026 05:43:32.761 7fbbf9a3ceb8 [contrail-device-manager] [DEBUG]: Extracted sandesh length: 0000001017 03/23/2026 05:43:32.763 7fbbf9a3ceb8 [contrail-device-manager] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/23/2026 05:43:32.763 7fbbfaba2780 [contrail-device-manager] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/23/2026 05:43:32.763 7fbbfaba2780 [contrail-device-manager] [DEBUG]: Number of uve types in sandesh control message is 0 03/23/2026 05:43:32.763 7fbbfaba2780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 03/23/2026 05:43:32.763 7fbbfaba2780 [contrail-device-manager] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/23/2026 05:43:32.764 7fbbfaba2780 [contrail-device-manager] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/23/2026 05:43:32.764 7fbbf9a54b70 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/23/2026 05:43:32.765 7fbbf9a54b70 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/23/2026 05:43:41.586 7fbc03664588 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/23/2026 05:43:41.586 7fbc03664588 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/23/2026 05:43:41.586 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/23/2026 05:43:41.588 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/23/2026 05:43:41.633 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/23/2026 05:43:41.640 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/23/2026 05:43:41.650 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/23/2026 05:43:41.676 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/23/2026 05:43:41.679 7fbc03664588 [contrail-device-manager] [ERROR]: Cassandra connection down. Exception in > 03/23/2026 05:43:41.783 7fbc03664588 [contrail-device-manager] [ERROR]: Error while initializing db connection, retrying: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Mar 23 05:43:41 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in walk(self=, fn=None) 1472 for obj_uuid, obj_col in self._cassandra_driver.get_range( 1473 datastore_api.OBJ_UUID_CF_NAME, 1474 columns=['type', 'fq_name']): 1475 try: 1476 obj_type = json.loads(obj_col['type']) columns undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get_Range(self=, cf_name='obj_uuid_table', columns=['type', 'fq_name'], column_count=100000, include_timestamp=False) 884 885 current_key, aggregator = None, [] 886 for row in ses.execute(cql, arg): 887 key, row = row[0], row[1:] 888 row undefined ses = ses.execute = > cql = '\n SELECT blobAsText(key), blobAsText(colu... (textAsBlob(%s), textAsBlob(%s)) ALLOW FILTERING' arg = ['type', 'fq_name'] /cassandra/cluster.py in cassandra.cluster.Session.execute() /cassandra/cluster.py in cassandra.cluster.ResponseFuture.result() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1474, in walk columns=['type', 'fq_name']): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 886, in _Get_Range for row in ses.execute(cql, arg): File "cassandra/cluster.py", line 2618, in cassandra.cluster.Session.execute File "cassandra/cluster.py", line 4901, in cassandra.cluster.ResponseFuture.result cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/23/2026 05:43:51.783 7fbc03664588 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/23/2026 05:43:51.784 7fbc03664588 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/23/2026 05:43:51.784 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/23/2026 05:43:51.787 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/23/2026 05:43:51.829 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/23/2026 05:43:51.838 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/23/2026 05:43:51.847 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/23/2026 05:43:51.867 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/23/2026 05:43:51.874 7fbc03664588 [contrail-device-manager] [ERROR]: Cassandra connection down. Exception in > 03/23/2026 05:43:51.892 7fbc03664588 [contrail-device-manager] [ERROR]: Error while initializing db connection, retrying: Error accessing error, ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}): NoHostAvailable Python 3.6.8: /usr/bin/python3 Mon Mar 23 05:43:51 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in wrapper(*args=(), **kwargs={}) 1029 self._Init_Cluster() 1030 self.start_time = datetime.datetime.now() 1031 return func(*args, **kwargs) 1032 except (connector.InvalidRequest, 1033 connector.cluster.NoHostAvailable, func = > args = () kwargs = {} /usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py in walk(self=, fn=None) 1472 for obj_uuid, obj_col in self._cassandra_driver.get_range( 1473 datastore_api.OBJ_UUID_CF_NAME, 1474 columns=['type', 'fq_name']): 1475 try: 1476 obj_type = json.loads(obj_col['type']) columns undefined /usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py in _Get_Range(self=, cf_name='obj_uuid_table', columns=['type', 'fq_name'], column_count=100000, include_timestamp=False) 884 885 current_key, aggregator = None, [] 886 for row in ses.execute(cql, arg): 887 key, row = row[0], row[1:] 888 row undefined ses = ses.execute = > cql = '\n SELECT blobAsText(key), blobAsText(colu... (textAsBlob(%s), textAsBlob(%s)) ALLOW FILTERING' arg = ['type', 'fq_name'] /cassandra/cluster.py in cassandra.cluster.Session.execute() /cassandra/cluster.py in cassandra.cluster.ResponseFuture.result() NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {'errors': {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}} __dir__ = __doc__ = '\n Raised when an operation is attempted but a...ct, closed, or resulted in errors when used.\n ' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __module__ = 'cassandra.cluster' __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = __weakref__ = None args = ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)}) errors = {: Unavailable('Error from server: code=1000 [Unava...required_replicas\': 2, \'alive_replicas\': 1}',)} with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1474, in walk columns=['type', 'fq_name']): File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 886, in _Get_Range for row in ses.execute(cql, arg): File "cassandra/cluster.py", line 2618, in cassandra.cluster.Session.execute File "cassandra/cluster.py", line 4901, in cassandra.cluster.ResponseFuture.result cassandra.cluster.NoHostAvailable: ('Unable to complete the operation against any hosts', {: Unavailable('Error from server: code=1000 [Unavailable exception] message="Cannot achieve consistency level QUORUM" info={\'consistency\': \'QUORUM\', \'required_replicas\': 2, \'alive_replicas\': 1}',)}) database due to: None 03/23/2026 05:44:01.893 7fbc03664588 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/23/2026 05:44:01.893 7fbc03664588 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/23/2026 05:44:01.894 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/23/2026 05:44:01.895 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/23/2026 05:44:01.987 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/23/2026 05:44:02.003 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/23/2026 05:44:02.027 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/23/2026 05:44:02.052 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/23/2026 05:44:02.107 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_status_consumer.dummy 03/23/2026 05:44:02.107 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_request_consumer 03/23/2026 05:44:02.107 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/23/2026 05:44:02.108 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5515-1. 03/23/2026 05:44:02.113 7fbc0950e630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/23/2026 05:44:02.126 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5515-1.'] 03/23/2026 05:44:02.155 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/23/2026 05:44:02.168 7fbc0950e630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/23/2026 05:44:02.194 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5515-1.'] 03/23/2026 05:44:02.716 7fbc03664588 [contrail-device-manager] [DEBUG]: Fetching all containers 03/23/2026 05:44:03.239 7fbc03664588 [contrail-device-manager] [INFO]: Restarting dnsmasq docker: config_dnsmasq_1 03/23/2026 05:44:03.949 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..config_queue 03/23/2026 05:44:03.949 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..tftp_queue 03/23/2026 05:44:04.205 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/23/2026 05:44:04.209 7fbc0950e630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/23/2026 05:44:04.245 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5515-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..tftp_queue'] 03/23/2026 05:44:04.450 7fbc03664588 [contrail-device-manager] [WARNING]: Process 135 prepared to run in Full mode... 03/23/2026 05:44:04.450 7fbc03664588 [contrail-device-manager] [WARNING]: Elected master Device Manager node. Initializing... 03/23/2026 05:44:04.450 7fbc03664588 [contrail-device-manager] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8096 03/23/2026 05:44:04.457 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [config_updater.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 03/23/2026 05:44:04.457 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 03/23/2026 05:44:04.457 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [greenlets.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 03/23/2026 05:44:04.457 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 03/23/2026 05:44:04.458 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [cpuinfo.xml:/usr/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 03/23/2026 05:44:04.458 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 03/23/2026 05:44:04.463 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [dm_introspect.xml:/usr/lib/python3.6/site-packages/device_manager/sandesh/dm_introspect] to home page 03/23/2026 05:44:04.463 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 03/23/2026 05:44:04.463 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualNetworkList] 03/23/2026 05:44:04.463 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_VirtualMachineInterfaceList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalInterfaceList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalInterfaceList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PhysicalRouterList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_BgpRouterList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_LogicalRouterList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_InstanceIpList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FloatingIpList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_PortTupleList] 03/23/2026 05:44:04.464 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_FeatureFlagList] 03/23/2026 05:44:04.466 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [sandesh_alarm.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 03/23/2026 05:44:04.466 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 03/23/2026 05:44:04.466 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 03/23/2026 05:44:04.466 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 03/23/2026 05:44:04.466 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [sandesh_ctrl.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [sandesh_trace.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 03/23/2026 05:44:04.467 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 03/23/2026 05:44:04.468 7fbc03664588 [contrail-device-manager] [DEBUG]: Add [sandesh_uve.xml:/usr/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 03/23/2026 05:44:04.468 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 03/23/2026 05:44:04.468 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 03/23/2026 05:44:04.468 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 03/23/2026 05:44:04.469 7fbc03664588 [contrail-device-manager] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 03/23/2026 05:44:04.477 7fbc03664588 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Added consumer: device_manager_ztp.ztp_queue 03/23/2026 05:44:04.738 7fbbf94dd240 [contrail-device-manager] [ERROR]: Cannot write http_port 8096 to /tmp/contrail-device-manager.1.http_port 03/23/2026 05:44:04.738 7fbbf94dd240 [contrail-device-manager] [ERROR]: Starting Introspect on HTTP Port 8096 03/23/2026 05:44:05.267 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Ensuring Consumer connection 03/23/2026 05:44:05.278 7fbc0950e630 [contrail-device-manager] [INFO]: KombuAmqpClient: Consumer connection established 03/23/2026 05:44:05.323 7fbc0950e630 [contrail-device-manager] [DEBUG]: KombuAmqpClient: Created consumers ['job_status_consumer.dummy', 'job_request_consumer', 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5515-1.', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..config_queue', 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5515-1..tftp_queue', 'device_manager_ztp.ztp_queue'] 03/23/2026 05:44:49.968 7fbc03664588 [contrail-device-manager] [ERROR]: network IPAM 'ipv6_link_local' already exists or other conflict: ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'] already exists with uuid: 3e70425f-ecc7-447f-a85f-e6c732c61e70 03/23/2026 05:44:50.053 7fbc03664588 [contrail-device-manager] [ERROR]: virtual network '_internal_vn_ipv6_link_local' already exists or other conflict: ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'] already exists with uuid: e4f581f0-d970-4ba0-bd31-941ea2a66487 03/23/2026 05:44:50.374 7fbc03664588 [contrail-device-manager] [WARNING]: VNCCassandra started with driver cql 03/23/2026 05:44:50.375 7fbc03664588 [contrail-device-manager] [WARNING]: initializing cassandra cluster 03/23/2026 05:44:50.375 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/23/2026 05:44:50.377 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/23/2026 05:44:50.433 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/23/2026 05:44:50.470 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/23/2026 05:44:50.494 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/23/2026 05:44:50.557 7fbc03664588 [contrail-device-manager] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/23/2026 05:44:50.644 7fbc03664588 [contrail-device-manager] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.38:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.33:5673//'] 03/23/2026 05:44:50.655 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection down 03/23/2026 05:44:50.655 7fbbf8bdf240 [contrail-device-manager] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/23/2026 05:44:50.656 7fbbf8bdf240 [contrail-device-manager] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/23/2026 05:44:50.661 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/23/2026 05:44:50.709 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/23/2026 05:44:50.718 7fbc03664588 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/23/2026 05:44:50.721 7fbbf8bdc828 [contrail-device-manager] [WARNING]: RabbitMQ publish connection down 03/23/2026 05:44:50.750 7fbbf8bdc828 [contrail-device-manager] [WARNING]: RabbitMQ publish connection ESTABLISHED