02/03/2025 00:50:56.436 7f324dd0b898 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 02/03/2025 00:50:56.436 7f324dd0b898 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 02/03/2025 00:50:56.436 7f324dd0b898 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 02/03/2025 00:50:56.436 7f324dd0b898 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:50:56.436 7f324dd0b898 [contrail-topology] [INFO]: Consistent scheduler zk start 02/03/2025 00:50:56.437 7f3247a37d48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 02/03/2025 00:50:56.437 7f3247a37d48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 02/03/2025 00:50:56.437 7f3244f9f848 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.438 7f3244f9f848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.439 7f3244f9f848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3.:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1738543856438099 collector_name = collector_ip = collector_list = [ 10.0.0.36:8086, 10.0.0.32:8086, 10.0.0.30:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 02/03/2025 00:50:56.439 7f3244f9f848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.448 7f3244ed9848 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 02/03/2025 00:50:56.449 7f3244f9f848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.449 7f3244f9f848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/03/2025 00:50:56.449 7f3244f9f848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.509 7f3244ed9b48 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.36:5673//', 'pyamqp://guest:guest@10.0.0.32:5673//', 'pyamqp://guest:guest@10.0.0.30:5673//'] 02/03/2025 00:50:56.512 7f3244ed9b48 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 02/03/2025 00:50:56.513 7f3244ed9e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.514 7f3244ed9e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/03/2025 00:50:56.514 7f3244ed9e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.514 7f3244ed9e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.514 7f3244ed9e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/03/2025 00:50:56.514 7f3244ed9e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.526 7f3244ed9b48 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 02/03/2025 00:50:56.527 7f3244ed9e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.527 7f3244ed9e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/03/2025 00:50:56.527 7f3244ed9e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.530 7f3244ed9a48 [contrail-topology] [DEBUG]: Waiting for allocation... 02/03/2025 00:50:56.688 7f3244ed9b48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 02/03/2025 00:50:56.689 7f3244ed9c48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.689 7f3244ed9c48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 02/03/2025 00:50:56.689 7f3244ed9c48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.697 7f3244ed9b48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 02/03/2025 00:50:56.697 7f3244ed9c48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.698 7f3244ed9c48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/03/2025 00:50:56.698 7f3244ed9c48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.701 7f3244ed9b48 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 02/03/2025 00:50:56.702 7f3244ed9b48 [contrail-topology] [WARNING]: initializing cassandra cluster 02/03/2025 00:50:56.702 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 02/03/2025 00:50:56.702 7f3244ed9c48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 02/03/2025 00:50:56.703 7f3244ed9e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.704 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 02/03/2025 00:50:56.713 7f3244ed9c48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 02/03/2025 00:50:56.713 7f323eae4248 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.713 7f323eae4248 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/03/2025 00:50:56.714 7f323eae4248 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.763 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 02/03/2025 00:50:56.768 7f323eae4b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.768 7f323eae4b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/03/2025 00:50:56.768 7f323eae4b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.797 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 02/03/2025 00:50:56.797 7f323eae4648 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.797 7f323eae4648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 02/03/2025 00:50:56.797 7f323eae4648 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.802 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 02/03/2025 00:50:56.844 7f3244ed9b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 02/03/2025 00:50:56.844 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:50:56.844 7f323ea4e948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 02/03/2025 00:50:56.844 7f323ea4e948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 02/03/2025 00:51:00.438 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [INFO]: Session Event: TCP Connected 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2672-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.32:2181, 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.36:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.32:5673, 10.0.0.30:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.32:9041, 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 02/03/2025 00:51:00.440 7f323ea4e948 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 02/03/2025 00:51:00.441 7f323ea4e948 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 02/03/2025 00:51:00.441 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/03/2025 00:51:00.441 7f323ea4e948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 02/03/2025 00:51:00.441 7f323ea4eb48 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/03/2025 00:51:00.442 7f323ea4eb48 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/03/2025 00:51:00.446 7f323ea4ea48 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001017 02/03/2025 00:51:00.446 7f323ea4ea48 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 02/03/2025 00:51:00.447 7f323ea4eb48 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 02/03/2025 00:51:00.447 7f323ea4eb48 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 02/03/2025 00:51:00.447 7f323ea4eb48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:51:00.447 7f323ea4eb48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 02/03/2025 00:51:00.447 7f323ea4eb48 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 02/03/2025 00:51:00.447 7f3244ed9948 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 02/03/2025 00:51:00.449 7f3244ed9948 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 02/03/2025 00:51:26.518 7f3244f9f848 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-ansible-os-2672-2.-1', 'cn-jenkins-deploy-platform-ansible-os-2672-1.-1', 'cn-jenkins-deploy-platform-ansible-os-2672-3.-1'] 02/03/2025 00:51:26.519 7f3244f9f848 [contrail-topology] [INFO]: partitions: ['1', '7', '14', '17', '18', '21', '23', '25', '27', '28', '31', '32', '43'] 02/03/2025 00:51:27.544 7f3244ed9a48 [contrail-topology] [DEBUG]: got work: ['1', '7', '14', '17', '18', '21', '23', '25', '27', '28', '31', '32', '43'] 02/03/2025 00:51:27.544 7f3244ed9a48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 02/03/2025 00:51:27.544 7f3244ed9a48 [contrail-topology] [DEBUG]: work items: [] from the list [] 02/03/2025 00:51:27.544 7f3244ed9a48 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 02/03/2025 00:52:50.748 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-d6b1cd80-4d49-4ed4-919f-853d2b5518dd', 'type': 'global_system_config', 'uuid': '4384c55a-db22-4e45-b2e5-b045bd5d7217'} 02/03/2025 00:52:50.878 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2672-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-2'], 'id_perms': {'created': '2025-02-03T00:52:50.871549', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-03T00:52:50.871549', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10384032109055901185, 'uuid_mslong': 17398488161409843211}}, 'parent_type': 'global-system-config', 'parent_uuid': '4384c55a-db22-4e45-b2e5-b045bd5d7217', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f173d8cd-39ac-400b-901b-7e2fac86fe01', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.23'}, 'oper': 'CREATE', 'request-id': 'req-b1ce10ca-6660-4d36-8aa1-1b29004d62b9', 'type': 'virtual_router', 'uuid': 'f173d8cd-39ac-400b-901b-7e2fac86fe01'} 02/03/2025 00:52:51.231 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-2', 'vhost0'], 'id_perms': {'created': '2025-02-03T00:52:51.209001', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-03T00:52:51.209001', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11865935708060288263, 'uuid_mslong': 8591629852849162519}}, 'parent_type': 'virtual-router', 'parent_uuid': 'f173d8cd-39ac-400b-901b-7e2fac86fe01', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '773b99d4-acb7-4917-a4ac-45a8768e8507', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:77:3b:99:d4:ac']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ba069717-392b-446d-8a8b-d13780b83b42'}]}, 'oper': 'CREATE', 'request-id': 'req-3794ecd4-df82-4de1-959b-116b647bb286', 'type': 'virtual_machine_interface', 'uuid': '773b99d4-acb7-4917-a4ac-45a8768e8507'} 02/03/2025 00:52:51.275 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-3794ecd4-df82-4de1-959b-116b647bb286', 'type': 'virtual_machine_interface', 'uuid': '773b99d4-acb7-4917-a4ac-45a8768e8507'} 02/03/2025 00:52:51.807 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-0b8891e3-9610-443b-85ca-c69cc2c5c650', 'type': 'access_control_list', 'uuid': 'cc6129f9-bd61-4b20-b1d2-a0aaf762d3db'} 02/03/2025 00:53:43.076 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2672-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-1'], 'id_perms': {'created': '2025-02-03T00:53:42.948752', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-03T00:53:42.948752', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10330400030955246122, 'uuid_mslong': 17543151478289747267}}, 'parent_type': 'global-system-config', 'parent_uuid': '4384c55a-db22-4e45-b2e5-b045bd5d7217', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f375cb52-6854-4d43-8f5c-f41868c5922a', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.11'}, 'oper': 'CREATE', 'request-id': 'req-6d57fcc4-5ede-4df4-bd38-5be6722d6f42', 'type': 'virtual_router', 'uuid': 'f375cb52-6854-4d43-8f5c-f41868c5922a'} 02/03/2025 00:53:43.424 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-1', 'vhost0'], 'id_perms': {'created': '2025-02-03T00:53:43.398997', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-02-03T00:53:43.398997', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10049016526478239418, 'uuid_mslong': 11587018582035546319}}, 'parent_type': 'virtual-router', 'parent_uuid': 'f375cb52-6854-4d43-8f5c-f41868c5922a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a0cd5c02-7c14-40cf-8b75-4749f2c3e6ba', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:a0:cd:5c:02:7c']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': 'ba069717-392b-446d-8a8b-d13780b83b42'}]}, 'oper': 'CREATE', 'request-id': 'req-86205e21-6bb2-4e78-9a5f-0aa2b2243a7f', 'type': 'virtual_machine_interface', 'uuid': 'a0cd5c02-7c14-40cf-8b75-4749f2c3e6ba'} 02/03/2025 00:53:43.474 7f3244ed9d48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2672-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-86205e21-6bb2-4e78-9a5f-0aa2b2243a7f', 'type': 'virtual_machine_interface', 'uuid': 'a0cd5c02-7c14-40cf-8b75-4749f2c3e6ba'} 02/03/2025 00:53:58.672 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:54:23.082 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:54:38.478 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:54:54.033 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:55:09.259 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:55:24.537 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:55:40.175 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:55:55.513 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:56:10.829 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:56:26.315 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:56:41.558 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:56:56.626 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:57:12.081 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:57:28.220 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:57:43.575 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:57:59.033 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:58:14.126 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:58:29.528 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:58:44.785 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:59:00.369 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:59:15.349 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:59:30.334 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 00:59:45.515 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:00:00.929 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:00:16.196 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:00:31.417 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:00:46.852 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:01:02.291 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:01:17.289 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:01:27.558 7f3244ed9a48 [contrail-topology] [DEBUG]: got work: ['1', '7', '14', '17', '18', '21', '23', '25', '27', '28', '31', '32', '43'] 02/03/2025 01:01:27.558 7f3244ed9a48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 02/03/2025 01:01:27.558 7f3244ed9a48 [contrail-topology] [DEBUG]: work items: [] from the list [] 02/03/2025 01:01:32.855 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:01:48.444 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:02:03.742 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:02:18.916 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:02:34.380 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:02:49.905 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:03:05.510 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:03:20.590 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:03:36.772 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:03:51.785 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:04:07.091 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:04:22.256 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:04:37.814 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:04:53.233 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:05:08.463 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:05:24.840 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:05:40.250 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:05:55.204 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:06:10.431 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:06:26.284 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:06:41.728 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:06:57.153 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:07:12.571 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:07:27.807 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:07:43.396 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:07:58.993 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:08:14.739 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:08:30.357 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:08:45.844 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:09:01.627 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:09:17.197 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:09:32.724 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:09:37.611 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:09:42.362 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 02/03/2025 01:10:19.067 7f3244f9f848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map