03/27/2025 00:51:52.275 7efed08ae898 [contrail-topology] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 03/27/2025 00:51:52.277 7efed08ae898 [contrail-topology] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 03/27/2025 00:51:52.277 7efed08ae898 [contrail-topology] [INFO]: SANDESH: Flow Logging: [None] -> [False] 03/27/2025 00:51:52.278 7efed08ae898 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:51:52.278 7efed08ae898 [contrail-topology] [INFO]: Consistent scheduler zk start 03/27/2025 00:51:52.280 7efeca5dcd48 [contrail-topology] [ERROR]: Cannot write http_port 5921 to /tmp/contrail-topology.0.http_port 03/27/2025 00:51:52.280 7efeca5dcd48 [contrail-topology] [ERROR]: Starting Introspect on HTTP Port 5921 03/27/2025 00:51:52.280 7efec7b47848 [contrail-topology] [INFO]: Processing event[EvStart] in state[none] 03/27/2025 00:51:52.282 7efec7b47848 [contrail-topology] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized] connection down >>, ] >> 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Initializing description = Connection to Zookeeper initialized >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[Connection to Zookeeper initialized], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3.:AnalyticsSNMP:contrail-topology:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 5921 start_time = 1743036712282801 collector_name = collector_ip = collector_list = [ 10.0.0.27:8086, 10.0.0.36:8086, 10.0.0.43:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 03/27/2025 00:51:52.283 7efec7b47848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.291 7efec7a80848 [contrail-topology] [INFO]: Consistent scheduler listen CONNECTED 03/27/2025 00:51:52.292 7efec7b47848 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.292 7efec7b47848 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:51:52.292 7efec7b47848 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.393 7efec7a80b48 [contrail-topology] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.36:5673//', 'pyamqp://guest:guest@10.0.0.27:5673//', 'pyamqp://guest:guest@10.0.0.43:5673//'] 03/27/2025 00:51:52.399 7efec7a80b48 [contrail-topology] [WARNING]: RabbitMQ drainer connection down 03/27/2025 00:51:52.400 7efec7a80e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.400 7efec7a80e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:51:52.400 7efec7a80e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.401 7efec7a80e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.401 7efec7a80e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:51:52.401 7efec7a80e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.422 7efec7a80b48 [contrail-topology] [WARNING]: RabbitMQ drainer connection ESTABLISHED 03/27/2025 00:51:52.423 7efec7a80e48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.423 7efec7a80e48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:51:52.423 7efec7a80e48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.424 7efec7a80a48 [contrail-topology] [DEBUG]: Waiting for allocation... 03/27/2025 00:51:52.888 7efec7a80b48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 03/27/2025 00:51:52.889 7efec7a80d48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.889 7efec7a80d48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 03/27/2025 00:51:52.889 7efec7a80d48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.960 7efec7a80b48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/27/2025 00:51:52.961 7efec7a80d48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.961 7efec7a80d48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:51:52.961 7efec7a80d48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.963 7efec7a80b48 [contrail-topology] [WARNING]: VNCCassandra started with driver cql 03/27/2025 00:51:52.963 7efec7a80b48 [contrail-topology] [WARNING]: initializing cassandra cluster 03/27/2025 00:51:52.964 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster before create 03/27/2025 00:51:52.964 7efec7a80d48 [contrail-topology] [WARNING]: RabbitMQ publish connection down 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = Connection to Zookeeper established >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 03/27/2025 00:51:52.965 7efec628f948 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:52.966 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster created 03/27/2025 00:51:53.012 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 03/27/2025 00:51:53.014 7efec5ebfb48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.015 7efec5ebfb48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 03/27/2025 00:51:53.015 7efec5ebfb48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.022 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 03/27/2025 00:51:53.024 7efec5ebfb48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.024 7efec5ebfb48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Down description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[], Database:Cassandra[] connection down >>, ] >> 03/27/2025 00:51:53.024 7efec5ebfb48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.044 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 03/27/2025 00:51:53.047 7efec7a80d48 [contrail-topology] [WARNING]: RabbitMQ publish connection ESTABLISHED 03/27/2025 00:51:53.048 7efec5e2d648 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.048 7efec5e2d648 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 03/27/2025 00:51:53.048 7efec5e2d648 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.092 7efec7a80b48 [contrail-topology] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 03/27/2025 00:51:53.095 7efec5e1fb48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:53.095 7efec5e1fb48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 03/27/2025 00:51:53.095 7efec5e1fb48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 03/27/2025 00:51:56.283 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [INFO]: Session Event: TCP Connected 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2962-3. process_status = [ << module_id = contrail-topology instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.36:2181, 10.0.0.27:2181, 10.0.0.43:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.27:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.36:5673, 10.0.0.27:5673, 10.0.0.43:5673, ] status = Up description = >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.36:9041, 10.0.0.27:9041, 10.0.0.43:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 03/27/2025 00:51:56.285 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvTcpConnected] in state[Connect] 03/27/2025 00:51:56.286 7efec5e1fd48 [contrail-topology] [DEBUG]: Send sandesh control message. uve type count # 5 03/27/2025 00:51:56.286 7efec5e1fd48 [contrail-topology] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 03/27/2025 00:51:56.286 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:56.286 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 03/27/2025 00:51:56.286 7efec5db5048 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/27/2025 00:51:56.287 7efec5db5048 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/27/2025 00:51:56.290 7efec5e1fe48 [contrail-topology] [DEBUG]: Extracted sandesh length: 0000001017 03/27/2025 00:51:56.291 7efec5e1fe48 [contrail-topology] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 03/27/2025 00:51:56.291 7efec5e1fd48 [contrail-topology] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 03/27/2025 00:51:56.292 7efec5e1fd48 [contrail-topology] [DEBUG]: Number of uve types in sandesh control message is 0 03/27/2025 00:51:56.292 7efec5e1fd48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:51:56.292 7efec5e1fd48 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 03/27/2025 00:51:56.292 7efec5e1fd48 [contrail-topology] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 03/27/2025 00:51:56.292 7efec7a80948 [contrail-topology] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 03/27/2025 00:51:56.294 7efec7a80948 [contrail-topology] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 03/27/2025 00:52:23.447 7efec7a80a48 [contrail-topology] [DEBUG]: Waiting for allocation... 03/27/2025 00:52:52.413 7efec7b47848 [contrail-topology] [INFO]: members: ['cn-jenkins-deploy-platform-ansible-os-2962-3.-1', 'cn-jenkins-deploy-platform-ansible-os-2962-2.-1', 'cn-jenkins-deploy-platform-ansible-os-2962-1.-1'] 03/27/2025 00:52:52.413 7efec7b47848 [contrail-topology] [INFO]: partitions: ['1', '2', '3', '5', '11', '14', '15', '17', '20', '22', '27', '28', '33', '34', '38', '44'] 03/27/2025 00:52:53.608 7efec7a80a48 [contrail-topology] [DEBUG]: got work: ['1', '2', '3', '5', '11', '14', '15', '17', '20', '22', '27', '28', '33', '34', '38', '44'] 03/27/2025 00:52:53.608 7efec7a80a48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 03/27/2025 00:52:53.608 7efec7a80a48 [contrail-topology] [DEBUG]: work items: [] from the list [] 03/27/2025 00:52:53.608 7efec7a80a48 [contrail-topology] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:TopologyUVE] map 03/27/2025 00:53:46.875 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e57e5409-58c1-412f-93c5-18c7323f053c', 'type': 'global_system_config', 'uuid': 'd46c1ff2-1fd9-4f91-afa4-a8c9ef3fdaac'} 03/27/2025 00:53:46.926 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-a3b183dd-e79e-4ea4-85a5-dbb88df13f5f', 'type': 'global_system_config', 'uuid': 'd46c1ff2-1fd9-4f91-afa4-a8c9ef3fdaac'} 03/27/2025 00:53:47.015 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2962-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-1'], 'id_perms': {'created': '2025-03-27T00:53:47.005997', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-27T00:53:47.005997', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11340839921940959295, 'uuid_mslong': 9596602363801586140}}, 'parent_type': 'global-system-config', 'parent_uuid': 'd46c1ff2-1fd9-4f91-afa4-a8c9ef3fdaac', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '852dfb01-4111-49dc-9d62-c1d299dc103f', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.5'}, 'oper': 'CREATE', 'request-id': 'req-8242eb6d-a9af-4b2f-9f14-a370dd2984db', 'type': 'virtual_router', 'uuid': '852dfb01-4111-49dc-9d62-c1d299dc103f'} 03/27/2025 00:53:47.080 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2962-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-2'], 'id_perms': {'created': '2025-03-27T00:53:47.070624', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-27T00:53:47.070624', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11508548855672746410, 'uuid_mslong': 7656434137105450911}}, 'parent_type': 'global-system-config', 'parent_uuid': 'd46c1ff2-1fd9-4f91-afa4-a8c9ef3fdaac', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a411e48-3c58-479f-9fb6-9435969a31aa', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.11'}, 'oper': 'CREATE', 'request-id': 'req-9a75b3de-34de-4076-9ffd-09e387ec274a', 'type': 'virtual_router', 'uuid': '6a411e48-3c58-479f-9fb6-9435969a31aa'} 03/27/2025 00:53:47.396 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-1', 'vhost0'], 'id_perms': {'created': '2025-03-27T00:53:47.377230', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-27T00:53:47.377230', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13505770319972453594, 'uuid_mslong': 12226853092335504853}}, 'parent_type': 'virtual-router', 'parent_uuid': '852dfb01-4111-49dc-9d62-c1d299dc103f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a9ae821b-598b-4dd5-bb6e-228ca3f8ccda', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:a9:ae:82:1b:59']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '56430df0-f5c1-4289-9e63-c7e8a940b9c7'}]}, 'oper': 'CREATE', 'request-id': 'req-132456bb-7532-47e1-9cda-070424a3aa98', 'type': 'virtual_machine_interface', 'uuid': 'a9ae821b-598b-4dd5-bb6e-228ca3f8ccda'} 03/27/2025 00:53:47.463 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-132456bb-7532-47e1-9cda-070424a3aa98', 'type': 'virtual_machine_interface', 'uuid': 'a9ae821b-598b-4dd5-bb6e-228ca3f8ccda'} 03/27/2025 00:53:47.488 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-2', 'vhost0'], 'id_perms': {'created': '2025-03-27T00:53:47.447274', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-03-27T00:53:47.447274', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12165650254294160315, 'uuid_mslong': 16017501251612462185}}, 'parent_type': 'virtual-router', 'parent_uuid': '6a411e48-3c58-479f-9fb6-9435969a31aa', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'de499886-23bc-4c69-a8d5-12732cd813bb', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:de:49:98:86:23']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '56430df0-f5c1-4289-9e63-c7e8a940b9c7'}]}, 'oper': 'CREATE', 'request-id': 'req-33382f39-a5cf-40ca-84ac-b26aebe04b9c', 'type': 'virtual_machine_interface', 'uuid': 'de499886-23bc-4c69-a8d5-12732cd813bb'} 03/27/2025 00:53:47.537 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2962-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-33382f39-a5cf-40ca-84ac-b26aebe04b9c', 'type': 'virtual_machine_interface', 'uuid': 'de499886-23bc-4c69-a8d5-12732cd813bb'} 03/27/2025 00:53:47.995 7efec7a80e48 [contrail-topology] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-e70b29b1-26f4-47de-8c25-e47fc72f2f3a', 'type': 'access_control_list', 'uuid': '5b01c67a-9b28-4d46-aec7-b95fe5c90b75'} 03/27/2025 00:54:40.585 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:55:01.158 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:55:21.850 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:55:41.758 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:56:02.014 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:56:23.066 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:56:42.876 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:57:02.607 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:57:23.650 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:57:43.398 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:58:03.740 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:58:25.723 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:58:45.860 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:59:05.933 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:59:27.253 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 00:59:47.155 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:00:59.076 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:01:20.395 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:01:41.225 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:02:01.558 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:02:22.216 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:02:42.492 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:02:53.622 7efec7a80a48 [contrail-topology] [DEBUG]: got work: ['1', '2', '3', '5', '11', '14', '15', '17', '20', '22', '27', '28', '33', '34', '38', '44'] 03/27/2025 01:02:53.622 7efec7a80a48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 03/27/2025 01:02:53.622 7efec7a80a48 [contrail-topology] [DEBUG]: work items: [] from the list [] 03/27/2025 01:03:03.056 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:03:24.027 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:03:44.437 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:04:04.833 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:04:25.557 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:04:45.427 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:05:06.397 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:05:27.350 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:05:48.050 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:06:08.803 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:06:29.185 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:06:49.569 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:07:11.062 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:07:31.367 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:07:51.487 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:08:12.609 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:08:33.177 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:08:53.358 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:09:14.315 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:09:34.354 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:09:55.033 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:10:15.818 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:10:36.396 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:10:57.254 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:11:17.946 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:11:38.337 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:11:58.933 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:12:19.520 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:12:40.357 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:12:53.636 7efec7a80a48 [contrail-topology] [DEBUG]: got work: ['1', '2', '3', '5', '11', '14', '15', '17', '20', '22', '27', '28', '33', '34', '38', '44'] 03/27/2025 01:12:53.636 7efec7a80a48 [contrail-topology] [DEBUG]: @populate_work_items(): done! 03/27/2025 01:12:53.636 7efec7a80a48 [contrail-topology] [DEBUG]: work items: [] from the list [] 03/27/2025 01:13:00.690 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:13:21.851 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:13:42.189 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:14:01.685 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:14:22.740 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:14:43.090 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:14:52.426 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:15:01.903 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map 03/27/2025 01:16:33.606 7efec7b47848 [contrail-topology] [DEBUG]: send sync_uve in the [ObjectAnalyticsSNMPInfo:NodeStatusUVE] map