03/24/2025 00:51:57.704 7f888baca898 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/24/2025 00:51:57.704 7f888baca898 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/24/2025 00:51:57.704 7f888baca898 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/24/2025 00:51:57.706 7f888baca898 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:51:57.708 7f888baca898 [contrail-topology] [INFO]: Consistent scheduler zk start 03/24/2025 00:51:57.708 7f88857f6d48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 03/24/2025 00:51:57.708 7f88857f6d48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 03/24/2025 00:51:57.710 7f8882d60848 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 03/24/2025 00:51:57.711 7f8882d60848 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:51:57.711 7f8882d60848 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/24/2025 00:51:57.711 7f8882d60848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.712 7f8882d60848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 03/24/2025 00:51:57.712 7f8882d60848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.712 7f8882d60848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.712 7f8882d60848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:51:57.712 7f8882d60848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.713 7f8882d60848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.713 7f8882d60848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1.:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1742777517710998 collector_name = collector_ip = collector_list = [ 10.0.0.57:8086, 10.0.0.23:8086, 10.0.0.50:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/24/2025 00:51:57.713 7f8882d60848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.731 7f8882c9b848 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 03/24/2025 00:51:57.732 7f8882d60848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.732 7f8882d60848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:51:57.732 7f8882d60848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.837 7f8882c9bb48 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.23:5673//', 'pyamqp://guest:guest@10.0.0.50:5673//', 'pyamqp://guest:guest@10.0.0.57:5673//'] 03/24/2025 00:51:57.847 7f8882c9bb48 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:51:57.852 7f8882c9be48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.891 7f8882c9bb48 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/24/2025 00:51:57.893 7f8882c9be48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.894 7f8882c9be48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:51:57.894 7f8882c9be48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.928 7f8882c9ba48 [contrail-topology] [DEBUG]: Waiting for allocation... 03/24/2025 00:51:57.972 7f8882c9bb48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 03/24/2025 00:51:57.973 7f8882c9bc48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.973 7f8882c9bc48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/24/2025 00:51:57.973 7f8882c9bc48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.987 7f8882c9bb48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/24/2025 00:51:57.988 7f8882c9bc48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.988 7f8882c9bc48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:51:57.988 7f8882c9bc48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.989 7f8882c9bb48 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 03/24/2025 00:51:57.989 7f8882c9bb48 [contrail-topology] [WARNING]: initializing cassandra cluster 03/24/2025 00:51:57.990 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/24/2025 00:51:57.990 7f8882c9bc48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 03/24/2025 00:51:57.990 7f8882c9be48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.991 7f8882c9be48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:57.991 7f8882c9be48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.991 7f8882c9be48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.991 7f8882c9be48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:57.991 7f8882c9be48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.993 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/24/2025 00:51:57.998 7f8882c9bc48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/24/2025 00:51:57.999 7f88814a8d48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:57.999 7f88814a8d48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:57.999 7f88814a8d48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.059 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/24/2025 00:51:58.061 7f88810e1948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.061 7f88810e1948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:58.061 7f88810e1948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.074 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/24/2025 00:51:58.074 7f88810e1648 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.074 7f88810e1648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/24/2025 00:51:58.074 7f88810e1648 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.084 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/24/2025 00:51:58.132 7f8882c9bb48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/24/2025 00:51:58.134 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:51:58.134 7f8881040b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/24/2025 00:51:58.134 7f8881040b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/24/2025 00:52:01.711 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [INFO]: Session Event: TCP Connected 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2938-1. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.23:2181, 10.0.0.50:2181, 10.0.0.57:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.57:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.23:5673, 10.0.0.50:5673, 10.0.0.57:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.23:9041, 10.0.0.50:9041, 10.0.0.57:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/24/2025 00:52:01.713 7f8881040b48 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 03/24/2025 00:52:01.714 7f8881040b48 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/24/2025 00:52:01.714 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:52:01.714 7f8881040b48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/24/2025 00:52:01.714 7f8881040d48 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 00:52:01.715 7f8881040d48 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 00:52:01.722 7f8881040c48 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001017 03/24/2025 00:52:01.722 7f8881040c48 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/24/2025 00:52:01.723 7f8881040d48 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/24/2025 00:52:01.723 7f8881040d48 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 03/24/2025 00:52:01.723 7f8881040d48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:52:01.723 7f8881040d48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/24/2025 00:52:01.723 7f8881040d48 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/24/2025 00:52:01.723 7f8882c9b948 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/24/2025 00:52:01.724 7f8882c9b948 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/24/2025 00:52:27.861 7f8882d60848 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-ansible-os-2938-1.-1', 'cn-jenkins-deploy-platform-ansible-os-2938-2.-1', 'cn-jenkins-deploy-platform-ansible-os-2938-3.-1'] 03/24/2025 00:52:27.861 7f8882d60848 [contrail-topology] [INFO]: partitions: ['9', '10', '13', '17', '21', '23', '29', '30', '35', '38', '39', '42', '43', '45', '46'] 03/24/2025 00:52:28.950 7f8882c9ba48 [contrail-topology] [DEBUG]: got work: ['9', '10', '13', '17', '21', '23', '29', '30', '35', '38', '39', '42', '43', '45', '46'] 03/24/2025 00:52:28.951 7f8882c9ba48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 03/24/2025 00:52:28.951 7f8882c9ba48 [contrail-topology] [DEBUG]: work items: [] from the list [] 03/24/2025 00:52:28.951 7f8882c9ba48 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 03/24/2025 00:53:46.784 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e69a5d34-384d-4b25-8439-a82d098c9ac5', 'type': 'global_system_config', 'uuid': 'e3cd32c4-56a7-4c68-ae12-bb80278a0ed6'} 03/24/2025 00:53:46.935 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2938-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-2'], 'id_perms': {'created': '2025-03-24T00:53:46.925563', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-24T00:53:46.925563', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10570124726377580446, 'uuid_mslong': 4540706568353432234}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e3cd32c4-56a7-4c68-ae12-bb80278a0ed6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3f03d490-f3fd-42aa-92b0-a06f8b4f079e', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.17'}, 'oper': 'CREATE', 'request-id': 'req-5a7a2451-8ac9-4871-8c72-bb8b91f48d32', 'type': 'virtual_router', 'uuid': '3f03d490-f3fd-42aa-92b0-a06f8b4f079e'} 03/24/2025 00:53:47.311 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-2', 'vhost0'], 'id_perms': {'created': '2025-03-24T00:53:47.290645', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-24T00:53:47.290645', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9686829712537091169, 'uuid_mslong': 8272535897481888782}}, 'parent_type': 'virtual-router', 'parent_uuid': '3f03d490-f3fd-42aa-92b0-a06f8b4f079e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '72cdf391-a913-440e-866e-884cef78fc61', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:72:cd:f3:91:a9']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '40b89d6c-6f2c-4155-8ecd-599c0381f464'}]}, 'oper': 'CREATE', 'request-id': 'req-65ab0794-622e-4f6f-8d12-8a10f67d2e19', 'type': 'virtual_machine_interface', 'uuid': '72cdf391-a913-440e-866e-884cef78fc61'} 03/24/2025 00:53:47.362 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-65ab0794-622e-4f6f-8d12-8a10f67d2e19', 'type': 'virtual_machine_interface', 'uuid': '72cdf391-a913-440e-866e-884cef78fc61'} 03/24/2025 00:53:47.749 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2938-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-1'], 'id_perms': {'created': '2025-03-24T00:53:47.734186', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-24T00:53:47.734186', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11484748125861271923, 'uuid_mslong': 5364495320038459916}}, 'parent_type': 'global-system-config', 'parent_uuid': 'e3cd32c4-56a7-4c68-ae12-bb80278a0ed6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4a728412-3e23-4a0c-9f62-059258cb5973', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.23'}, 'oper': 'CREATE', 'request-id': 'req-3652bf1e-ff9e-4c00-9d66-be1bcb1eac49', 'type': 'virtual_router', 'uuid': '4a728412-3e23-4a0c-9f62-059258cb5973'} 03/24/2025 00:53:47.903 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-25d0a203-fd86-40e6-a456-f78f780d58d6', 'type': 'access_control_list', 'uuid': '0b84bb60-a7e8-4561-a792-9df6440330fc'} 03/24/2025 00:53:48.137 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-1', 'vhost0'], 'id_perms': {'created': '2025-03-24T00:53:48.115591', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-24T00:53:48.115591', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10455309157077749159, 'uuid_mslong': 1341760019687886425}}, 'parent_type': 'virtual-router', 'parent_uuid': '4a728412-3e23-4a0c-9f62-059258cb5973', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '129ee3a1-0351-4e59-9118-b848a4820da7', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:12:9e:e3:a1:03']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '40b89d6c-6f2c-4155-8ecd-599c0381f464'}]}, 'oper': 'CREATE', 'request-id': 'req-9833e6f2-f767-4799-b1bd-d5b0a4fc1dc7', 'type': 'virtual_machine_interface', 'uuid': '129ee3a1-0351-4e59-9118-b848a4820da7'} 03/24/2025 00:53:48.229 7f8882c9bd48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2938-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-9833e6f2-f767-4799-b1bd-d5b0a4fc1dc7', 'type': 'virtual_machine_interface', 'uuid': '129ee3a1-0351-4e59-9118-b848a4820da7'} 03/24/2025 00:54:04.164 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:54:16.314 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:54:29.389 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:54:41.693 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:54:53.818 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:55:05.966 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:55:18.319 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:55:31.157 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:55:43.361 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:55:55.482 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:56:07.835 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:56:20.073 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:56:32.653 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:56:44.921 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:56:57.261 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:57:09.665 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:57:22.028 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:57:34.195 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:57:46.461 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:57:58.678 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:58:10.901 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:58:23.127 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:58:35.368 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:58:47.658 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:58:59.940 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:59:12.322 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:59:24.568 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:59:36.981 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 00:59:49.252 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:00:01.441 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:00:15.075 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:00:27.459 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:00:40.127 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:00:52.793 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:01:05.112 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:01:17.410 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:01:29.787 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:01:42.825 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:01:54.992 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:02:07.282 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:02:19.565 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:02:28.967 7f8882c9ba48 [contrail-topology] [DEBUG]: got work: ['9', '10', '13', '17', '21', '23', '29', '30', '35', '38', '39', '42', '43', '45', '46'] 03/24/2025 01:02:28.967 7f8882c9ba48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 03/24/2025 01:02:28.967 7f8882c9ba48 [contrail-topology] [DEBUG]: work items: [] from the list [] 03/24/2025 01:02:31.628 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:02:44.369 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:02:56.522 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:03:09.072 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:03:21.425 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:03:33.611 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:03:46.031 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:03:58.223 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:04:10.676 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:04:23.027 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:04:35.295 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:04:47.655 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:05:00.216 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:05:12.474 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:05:24.713 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:05:36.847 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:05:49.156 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:06:01.467 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:06:13.843 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:06:26.193 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:06:28.645 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:06:31.090 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/24/2025 01:07:03.831 7f8882d60848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map