2025-09-18 01:25:25,375 - DEBUG - [10.0.0.48]: Running cmd : hostname 2025-09-18 01:25:25,630 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-250-1 2025-09-18 01:25:25,630 - DEBUG - [10.0.0.48]: Running cmd : hostname -f 2025-09-18 01:25:25,747 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-250-1.cluster.local 2025-09-18 01:25:25,747 - DEBUG - [10.0.0.48]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2025-09-18 01:25:25,908 - DEBUG - Output : NAMES contrail_test_YOLPo9vek k8s_autoscaler_dns-autoscaler-595558c478-4csxc_kube-system_3faa7f79-c2c5-4e61-ab7b-3477751651a1_0 k8s_coredns_coredns-77f7cc69db-xfpwr_kube-system_82cb63eb-5f66-4613-a243-96a9c6ac0b39_0 k8s_opensdn-controller-config-nodemgr_opensdn-controller-config-sxb8m_kube-system_4192a1c6-0544-4378-b4d9-fa938578d604_0 k8s_opensdn-controller-config-svcmonitor_opensdn-controller-config-sxb8m_kube-system_4192a1c6-0544-4378-b4d9-fa938578d604_0 k8s_opensdn-controller-config-schema_opensdn-controller-config-sxb8m_kube-system_4192a1c6-0544-4378-b4d9-fa938578d604_0 k8s_opensdn-analytics-query-engine_opensdn-analyticsdb-gftbs_kube-system_97aef43f-9bf3-4327-82bd-689587961865_0 k8s_opensdn-controller-nodemgr_opensdn-controller-control-426rz_kube-system_fcb1871b-9f58-4971-9e9f-9557d15b1d10_0 k8s_opensdn-controller-control-named_opensdn-controller-control-426rz_kube-system_fcb1871b-9f58-4971-9e9f-9557d15b1d10_0 k8s_opensdn-controller-config-devicemgr_opensdn-controller-config-sxb8m_kube-system_4192a1c6-0544-4378-b4d9-fa938578d604_0 k8s_opensdn-analytics-nodemgr_opensdn-analytics-mzq2s_kube-system_799a3b41-a08b-468d-955d-794ab085a77b_0 k8s_opensdn-analytics-collector_opensdn-analytics-mzq2s_kube-system_799a3b41-a08b-468d-955d-794ab085a77b_0 k8s_opensdn-analytics-alarm-nodemgr_opensdn-analytics-alarm-thgxw_kube-system_4200ba00-bb68-46f2-883c-8e156742236d_0 k8s_opensdn-analytics-alarm-gen_opensdn-analytics-alarm-thgxw_kube-system_4200ba00-bb68-46f2-883c-8e156742236d_0 k8s_opensdn-analyticsdb_opensdn-analyticsdb-gftbs_kube-system_97aef43f-9bf3-4327-82bd-689587961865_0 k8s_opensdn-controller-webui-web_opensdn-controller-webui-vz5km_kube-system_fcc8e266-b543-47d1-9556-99db58dceb4b_0 k8s_opensdn-controller-control-dns_opensdn-controller-control-426rz_kube-system_fcb1871b-9f58-4971-9e9f-9557d15b1d10_0 k8s_opensdn-analytics-snmp-nodemgr_opensdn-analytics-snmp-ldckb_kube-system_6cf75edc-973c-4aa3-98d1-0dc87e5f7923_0 k8s_opensdn-analytics-snmp-topology_opensdn-analytics-snmp-ldckb_kube-system_6cf75edc-973c-4aa3-98d1-0dc87e5f7923_0 k8s_opensdn-controller-config-api_opensdn-controller-config-sxb8m_kube-system_4192a1c6-0544-4378-b4d9-fa938578d604_0 k8s_opensdn-analytics-api_opensdn-analytics-mzq2s_kube-system_799a3b41-a08b-468d-955d-794ab085a77b_0 k8s_kafka_opensdn-analytics-alarm-thgxw_kube-system_4200ba00-bb68-46f2-883c-8e156742236d_0 k8s_opensdn-analyticsdb-nodemgr_opensdn-analyticsdb-gftbs_kube-system_97aef43f-9bf3-4327-82bd-689587961865_0 k8s_opensdn-controller-webui-job_opensdn-controller-webui-vz5km_kube-system_fcc8e266-b543-47d1-9556-99db58dceb4b_0 k8s_opensdn-controller-control_opensdn-controller-control-426rz_kube-system_fcb1871b-9f58-4971-9e9f-9557d15b1d10_0 k8s_opensdn-analytics-snmp-collector_opensdn-analytics-snmp-ldckb_kube-system_6cf75edc-973c-4aa3-98d1-0dc87e5f7923_0 k8s_opensdn-config-database-nodemgr_opensdn-configdb-khxgk_kube-system_a4f9c34f-c60e-458f-984b-15206af02451_0 k8s_opensdn-configdb_opensdn-configdb-khxgk_kube-system_a4f9c34f-c60e-458f-984b-15206af02451_0 k8s_config-zookeeper_config-zookeeper-75zgf_kube-system_12139128-01e4-4174-85ea-41bb0efa9a49_0 k8s_redis_redis-n5bhx_kube-system_e4e3862a-43d8-454e-a882-559c3f1c67eb_0 k8s_rabbitmq_rabbitmq-klgwg_kube-system_6b5c0a61-0e1c-4429-ac0d-9e6a9bd2a998_0 k8s_opensdn-agent-nodemgr_opensdn-agent-ws4zx_kube-system_e345cda5-bd1e-4094-b0a6-eef5ad1758a7_0 k8s_opensdn-vrouter-agent_opensdn-agent-ws4zx_kube-system_e345cda5-bd1e-4094-b0a6-eef5ad1758a7_0 k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 k8s_kube-proxy_kube-proxy-9fvx9_kube-system_b18d1df8-043f-41f7-9b7c-63a16cbf06e7_0 k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-250-1_kube-system_41b6e9ced12a0e922c7be3167bfeda71_1 k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-250-1_kube-system_543c5a2c5f54ad92624071e43ae29fe0_1 k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-250-1_kube-system_e58cdfef9b49f2d26a86b254eb3f3d8e_0 2025-09-18 01:25:25,908 - DEBUG - [10.0.0.48]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2025-09-18 01:25:26,029 - DEBUG - Output : 127.0.0.1/8 172.17.0.1/16 10.96.0.1/32 10.96.0.3/32 10.0.0.48/24 2025-09-18 01:25:26,030 - DEBUG - [10.0.0.48]: Running cmd : getent hosts 10.0.0.48 | head -n 1 | awk '{print $2}' 2025-09-18 01:25:26,152 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-250-1.cluster.local 2025-09-18 01:25:26,152 - DEBUG - [10.0.0.48]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2025-09-18 01:25:26,274 - DEBUG - Output : 10.0.0.48/24 2025-09-18 01:25:26,623 - INFO - Using existing project ['default-domain', 'k8s-default'](dcd0563a-7d85-4c79-96bd-3d8bd599cebd) 2025-09-18 01:25:26,770 - INFO - Using existing project ['default-domain', 'k8s-default'](dcd0563a-7d85-4c79-96bd-3d8bd599cebd) 2025-09-18 01:25:26,895 - INFO - ================================================================================ 2025-09-18 01:25:26,895 - INFO - STARTING TEST : test_ingress_ip_assignment 2025-09-18 01:25:26,896 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2025-09-18 01:25:27,187 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq? 2025-09-18 01:25:27,193 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with 2025-09-18 01:25:27,193 - INFO - Initial checks done. Running the testcase now 2025-09-18 01:25:27,193 - INFO - 2025-09-18 01:25:27,197 - INFO - Namespace default already exists 2025-09-18 01:25:27,198 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2025-09-18 01:25:27,373 - DEBUG - Output : cluster_project={} 2025-09-18 01:25:27,449 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2025-09-18 01:25:27,449 - DEBUG - Project uuid in Contrail is dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:27,449 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2025-09-18 01:25:27,607 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2025-09-18 01:25:27,607 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=8e7e25a5-9fc7-4559-b2c6-fb3b70c29902 2025-09-18 01:25:27,611 - INFO - Namespace default with uuid 8e7e25a5-9fc7-4559-b2c6-fb3b70c29902 found in kube manager 2025-09-18 01:25:27,611 - INFO - Namespace default verification passed 2025-09-18 01:25:27,614 - DEBUG - Service ctest-nginx-svc-58107600 not present 2025-09-18 01:25:27,614 - INFO - Creating service ctest-nginx-svc-58107600 2025-09-18 01:25:27,628 - INFO - Created Service ctest-nginx-svc-58107600 2025-09-18 01:25:27,632 - DEBUG - Pod ctest-nginx-pod-34722418 not present 2025-09-18 01:25:27,633 - INFO - Creating Pod ctest-nginx-pod-34722418 2025-09-18 01:25:27,670 - DEBUG - Pod : ctest-nginx-pod-34722418 UUID is f6ec3f08-4a40-44b6-a685-4f814117414e 2025-09-18 01:25:27,675 - DEBUG - Pod ctest-nginx-pod-98378902 not present 2025-09-18 01:25:27,676 - INFO - Creating Pod ctest-nginx-pod-98378902 2025-09-18 01:25:27,707 - DEBUG - Pod : ctest-nginx-pod-98378902 UUID is 1177ad29-5eed-4c19-a2ec-c57bbd9273a6 2025-09-18 01:25:27,959 - INFO - Created VN __public__, UUID :7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:28,203 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:25:28,210 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:25:28,277 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:28,324 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:28,333 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:28,343 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:28,349 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:28,360 - DEBUG - Route Targets: [] 2025-09-18 01:25:28,360 - DEBUG - RT names not yet present for VN __public__ 2025-09-18 01:25:33,361 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:25:33,366 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:25:33,377 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:33,426 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,434 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,441 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:33,448 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:33,453 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b59bec91-23dd-465d-a81e-899cbef8e989 2025-09-18 01:25:33,457 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-18 01:25:33,457 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,463 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:33,474 - INFO - Verified VN network id 11 for VN 7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,474 - INFO - Verifications in API Server for VN __public__ passed 2025-09-18 01:25:33,474 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,481 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:33,485 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:25:33,490 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/b59bec91-23dd-465d-a81e-899cbef8e989 2025-09-18 01:25:33,494 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2025-09-18 01:25:33,499 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8602334565068719192', 'uuid-lslong': '11140989524594258122'}, 'enable': 'true', 'created': '2025-09-18T01:25:27', 'last-modified': '2025-09-18T01:25:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.415807'} 2025-09-18 01:25:33,499 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:25:33,506 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-09-18 01:25:33,506 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2025-09-18 01:25:33,506 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2025-09-18 01:25:33,506 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:25:33,511 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:25:33,517 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:33,546 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:33,553 - DEBUG - =>VN __public__ has no policy to be verified 2025-09-18 01:25:33,554 - DEBUG - Verifying the vn in opserver 2025-09-18 01:25:33,554 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.48 2025-09-18 01:25:33,554 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-09-18 01:25:33,561 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2025-09-18 01:25:33,561 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2025-09-18 01:25:33,561 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:25:33,567 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:25:33,571 - DEBUG - Do not have enough data to verify VN in agent 2025-09-18 01:25:33,571 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:25:33,575 - DEBUG - VRF ids for VN __public__: {} 2025-09-18 01:25:33,741 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2025-09-18 01:25:33,952 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:25:33,964 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:25:33,970 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:34,022 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:34,032 - DEBUG - Requesting: http://10.0.0.48:8082/floating-ip-pool/a0f22ded-b1e7-4855-936d-9ca042ed748a 2025-09-18 01:25:34,041 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:25:34,046 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:25:34,054 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:25:34,101 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7761a1b5-b5fc-4458-9a9c-bef1f3c9f0ca 2025-09-18 01:25:34,110 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2025-09-18 01:25:34,110 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2025-09-18 01:25:34,116 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2025-09-18 01:25:34,122 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2025-09-18 01:25:34,122 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2025-09-18 01:25:34,125 - DEBUG - Ingress ctest-nginx-ingress-50833818 not present 2025-09-18 01:25:34,126 - INFO - Creating Ingress ctest-nginx-ingress-50833818 2025-09-18 01:25:34,133 - INFO - Created Ingress ctest-nginx-ingress-50833818 2025-09-18 01:25:34,137 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-50833818 2025-09-18 01:25:37,142 - DEBUG - For Ingress ctest-nginx-ingress-50833818, Cluster IP: 10.47.255.248, External IPs ['187.215.212.60'] 2025-09-18 01:25:37,142 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-50833818 2025-09-18 01:25:37,142 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=869ec31a-a919-412f-9619-0f1d6f91fe33 2025-09-18 01:25:37,154 - INFO - Ingress ctest-nginx-ingress-50833818 with uuid 869ec31a-a919-412f-9619-0f1d6f91fe33 found in kube manager 2025-09-18 01:25:37,154 - INFO - Ingress ctest-nginx-ingress-50833818 verification passed 2025-09-18 01:25:37,157 - DEBUG - Pod ctest-busybox-pod-68758920 not present 2025-09-18 01:25:37,157 - INFO - Creating Pod ctest-busybox-pod-68758920 2025-09-18 01:25:37,181 - DEBUG - Pod : ctest-busybox-pod-68758920 UUID is 30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:25:37,189 - DEBUG - Pod ctest-nginx-pod-34722418 not in running state.Currently in Pending 2025-09-18 01:25:42,200 - DEBUG - Pod ctest-nginx-pod-34722418 not in running state.Currently in Pending 2025-09-18 01:25:47,208 - INFO - Pod ctest-nginx-pod-34722418 is in running state.Got IP 10.47.255.250 2025-09-18 01:25:47,260 - DEBUG - Pod ctest-nginx-pod-34722418 has vmi 5d5eef2c-942e-11f0-89ef-024230831c95 2025-09-18 01:25:47,260 - INFO - Verified pod ctest-nginx-pod-34722418 in contrail-api 2025-09-18 01:25:47,260 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:25:47,271 - DEBUG - VMI 5d5eef2c-942e-11f0-89ef-024230831c95 is active in agent 10.0.0.48 2025-09-18 01:25:47,271 - INFO - Verified Pod ctest-nginx-pod-34722418 in agent 10.0.0.48 2025-09-18 01:25:47,271 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=f6ec3f08-4a40-44b6-a685-4f814117414e 2025-09-18 01:25:47,275 - INFO - Pod ctest-nginx-pod-34722418 with uuid f6ec3f08-4a40-44b6-a685-4f814117414e found in kube manager 2025-09-18 01:25:47,275 - INFO - Pod ctest-nginx-pod-34722418 verification passed 2025-09-18 01:25:47,356 - DEBUG - [Pod ctest-nginx-pod-34722418] Cmd: echo ctest-nginx-pod-34722418 > /usr/share/nginx/html/index.html, Output: 2025-09-18 01:25:47,363 - INFO - Pod ctest-nginx-pod-98378902 is in running state.Got IP 10.47.255.249 2025-09-18 01:25:47,414 - DEBUG - Pod ctest-nginx-pod-98378902 has vmi 5e0b66da-942e-11f0-89ef-024230831c95 2025-09-18 01:25:47,414 - INFO - Verified pod ctest-nginx-pod-98378902 in contrail-api 2025-09-18 01:25:47,414 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:25:47,423 - DEBUG - VMI 5e0b66da-942e-11f0-89ef-024230831c95 is active in agent 10.0.0.48 2025-09-18 01:25:47,423 - INFO - Verified Pod ctest-nginx-pod-98378902 in agent 10.0.0.48 2025-09-18 01:25:47,423 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1177ad29-5eed-4c19-a2ec-c57bbd9273a6 2025-09-18 01:25:47,427 - INFO - Pod ctest-nginx-pod-98378902 with uuid 1177ad29-5eed-4c19-a2ec-c57bbd9273a6 found in kube manager 2025-09-18 01:25:47,427 - INFO - Pod ctest-nginx-pod-98378902 verification passed 2025-09-18 01:25:47,503 - DEBUG - [Pod ctest-nginx-pod-98378902] Cmd: echo ctest-nginx-pod-98378902 > /usr/share/nginx/html/index.html, Output: 2025-09-18 01:25:47,510 - INFO - Pod ctest-busybox-pod-68758920 is in running state.Got IP 10.47.255.247 2025-09-18 01:25:47,562 - DEBUG - Pod ctest-busybox-pod-68758920 has vmi 62b74884-942e-11f0-89ef-024230831c95 2025-09-18 01:25:47,562 - INFO - Verified pod ctest-busybox-pod-68758920 in contrail-api 2025-09-18 01:25:47,562 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:25:47,570 - DEBUG - VMI 62b74884-942e-11f0-89ef-024230831c95 is active in agent 10.0.0.48 2025-09-18 01:25:47,571 - INFO - Verified Pod ctest-busybox-pod-68758920 in agent 10.0.0.48 2025-09-18 01:25:47,571 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:25:47,575 - INFO - Pod ctest-busybox-pod-68758920 with uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 found in kube manager 2025-09-18 01:25:47,575 - INFO - Pod ctest-busybox-pod-68758920 verification passed 2025-09-18 01:25:47,640 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% ctest-nginx-pod-98378902 |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,640 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,640 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% ctest-nginx-pod-98378902 |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,708 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-98378902 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,708 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,708 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-98378902 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,781 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-98378902 2025-09-18 01:25:47,781 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,781 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-98378902 2025-09-18 01:25:47,849 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-98378902 2025-09-18 01:25:47,849 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,849 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-98378902 2025-09-18 01:25:47,914 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-98378902 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,914 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,914 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-98378902 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,979 - DEBUG - [Pod ctest-busybox-pod-68758920] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-34722418 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,979 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2025-09-18 01:25:47,979 - DEBUG - [Pod Pod ctest-busybox-pod-68758920] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-34722418 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2025-09-18 01:25:47,979 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-34722418': 1, 'ctest-nginx-pod-98378902': 5} 2025-09-18 01:25:47,979 - WARNING - Nothing to delete parallely 2025-09-18 01:25:47,979 - INFO - Deleting pod default:ctest-busybox-pod-68758920 2025-09-18 01:25:47,995 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:25:48,002 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:25:53,003 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:25:53,010 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:25:58,011 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:25:58,018 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:03,018 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:26:03,025 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:08,025 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:26:08,031 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:13,031 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:26:13,037 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:18,038 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:26:18,044 - WARNING - Pod uuid 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:23,045 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=30ba4ebd-bae1-4bf5-bd33-afb20d017253 2025-09-18 01:26:23,052 - DEBUG - Pod 30ba4ebd-bae1-4bf5-bd33-afb20d017253 is not in agent 10.0.0.48 VM list 2025-09-18 01:26:23,052 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:62b74884-942e-11f0-89ef-024230831c95 2025-09-18 01:26:23,057 - DEBUG - VMI 62b74884-942e-11f0-89ef-024230831c95 is removed from agent 10.0.0.48 2025-09-18 01:26:23,057 - INFO - Verified that pod ctest-busybox-pod-68758920 is removed in agent 2025-09-18 01:26:23,057 - INFO - Deleting Ingress : ctest-nginx-ingress-50833818 2025-09-18 01:26:23,064 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=869ec31a-a919-412f-9619-0f1d6f91fe33 2025-09-18 01:26:23,067 - ERROR - Ingress ctest-nginx-ingress-50833818 with uuid 869ec31a-a919-412f-9619-0f1d6f91fe33 still found in kube manager 2025-09-18 01:26:24,068 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=869ec31a-a919-412f-9619-0f1d6f91fe33 2025-09-18 01:26:24,077 - ERROR - Ingress ctest-nginx-ingress-50833818 with uuid 869ec31a-a919-412f-9619-0f1d6f91fe33 still found in kube manager 2025-09-18 01:26:25,077 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=869ec31a-a919-412f-9619-0f1d6f91fe33 2025-09-18 01:26:25,081 - INFO - Ingress ctest-nginx-ingress-50833818 with uuid 869ec31a-a919-412f-9619-0f1d6f91fe33 deleted successfully from kube manager 2025-09-18 01:26:25,081 - INFO - Verifications on Ingress %s cleanup passed 2025-09-18 01:26:25,082 - INFO - Deleting the FIP pool __fip_pool_public__ 2025-09-18 01:26:25,163 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2025-09-18 01:26:25,172 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2025-09-18 01:26:25,172 - INFO - Deleting VN __public__ 2025-09-18 01:26:25,339 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/8a076b7e-99bf-4e7c-aee4-95a6e4b82fca 2025-09-18 01:26:25,357 - DEBUG - Response Code: 404 2025-09-18 01:26:25,358 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-09-18 01:26:25,382 - DEBUG - Requesting: http://10.0.0.48:8082/domain/4e35e80f-a969-46d3-bec6-9c70f29234e4 2025-09-18 01:26:25,390 - DEBUG - Requesting: http://10.0.0.48:8082/project/dcd0563a-7d85-4c79-96bd-3d8bd599cebd 2025-09-18 01:26:25,428 - INFO - Validated that VN __public__ is not found in API Server 2025-09-18 01:26:25,429 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2025-09-18 01:26:25,435 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:26:25,440 - DEBUG - VN __public__ is not present in Agent 10.0.0.48 2025-09-18 01:26:25,440 - INFO - Validated that VN __public__ is not in any agent 2025-09-18 01:26:25,440 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:26:25,444 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2025-09-18 01:26:25,448 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2025-09-18 01:26:25,453 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2025-09-18 01:26:25,454 - INFO - Deleting pod default:ctest-nginx-pod-98378902 2025-09-18 01:26:25,463 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=1177ad29-5eed-4c19-a2ec-c57bbd9273a6 2025-09-18 01:26:25,468 - WARNING - Pod uuid 1177ad29-5eed-4c19-a2ec-c57bbd9273a6 is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:30,470 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=1177ad29-5eed-4c19-a2ec-c57bbd9273a6 2025-09-18 01:26:30,474 - DEBUG - Pod 1177ad29-5eed-4c19-a2ec-c57bbd9273a6 is not in agent 10.0.0.48 VM list 2025-09-18 01:26:30,474 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5e0b66da-942e-11f0-89ef-024230831c95 2025-09-18 01:26:30,479 - DEBUG - VMI 5e0b66da-942e-11f0-89ef-024230831c95 is removed from agent 10.0.0.48 2025-09-18 01:26:30,479 - INFO - Verified that pod ctest-nginx-pod-98378902 is removed in agent 2025-09-18 01:26:30,479 - INFO - Deleting pod default:ctest-nginx-pod-34722418 2025-09-18 01:26:30,507 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=f6ec3f08-4a40-44b6-a685-4f814117414e 2025-09-18 01:26:30,513 - WARNING - Pod uuid f6ec3f08-4a40-44b6-a685-4f814117414e is still seen in agent 10.0.0.48 VM list 2025-09-18 01:26:35,514 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=f6ec3f08-4a40-44b6-a685-4f814117414e 2025-09-18 01:26:35,519 - DEBUG - Pod f6ec3f08-4a40-44b6-a685-4f814117414e is not in agent 10.0.0.48 VM list 2025-09-18 01:26:35,519 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5d5eef2c-942e-11f0-89ef-024230831c95 2025-09-18 01:26:35,523 - DEBUG - VMI 5d5eef2c-942e-11f0-89ef-024230831c95 is removed from agent 10.0.0.48 2025-09-18 01:26:35,523 - INFO - Verified that pod ctest-nginx-pod-34722418 is removed in agent 2025-09-18 01:26:35,524 - INFO - Deleting service : ctest-nginx-svc-58107600 2025-09-18 01:26:36,087 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq? 2025-09-18 01:26:36,094 - DEBUG - No XMPP flaps were noticed during the test 2025-09-18 01:26:36,095 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:10] 2025-09-18 01:26:36,095 - INFO - -------------------------------------------------------------------------------- 2025-09-18 01:26:42,632 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2025-09-18 01:26:42,855 - DEBUG - Output : cluster_project={} 2025-09-18 01:26:42,930 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2025-09-18 01:26:43,152 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2025-09-18 01:26:43,163 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-w4kh8_kube-system_43e05cb6-9b82-4150-8758-b6741ec339b8_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2025-09-18 01:26:43,348 - DEBUG - Output : cluster_project={} 2025-09-18 01:26:58,569 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:26:58,684 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:26:58,798 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:03,878 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:03,995 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:04,109 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:04,224 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:09,306 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2025-09-18 01:27:09,608 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq? 2025-09-18 01:27:12,732 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_ApplicationPolicySetReq? 2025-09-18 01:27:12,738 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq? 2025-09-18 01:27:12,758 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq? 2025-09-18 01:27:14,779 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq? 2025-09-18 01:27:16,798 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq? 2025-09-18 01:30:18,449 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq? 2025-09-18 01:30:18,496 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8c48abe-3fa9-406f-bbab-527270e04e70 2025-09-18 01:30:18,512 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:18,518 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=60d9648d-1ec9-4c8d-9742-b972aee95be3 2025-09-18 01:30:18,525 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:18,537 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=3e5fe10c-1d4c-4e0c-8bbd-e859e48018f8 2025-09-18 01:30:18,547 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:18,556 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=c343d08e-2027-41cc-b31b-6f78680162f6 2025-09-18 01:30:18,575 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:23,603 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:23,605 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=3e5fe10c-1d4c-4e0c-8bbd-e859e48018f8 2025-09-18 01:30:23,607 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=c343d08e-2027-41cc-b31b-6f78680162f6 2025-09-18 01:30:23,608 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:23,609 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:23,610 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:23,612 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8c48abe-3fa9-406f-bbab-527270e04e70 2025-09-18 01:30:23,613 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=60d9648d-1ec9-4c8d-9742-b972aee95be3 2025-09-18 01:30:23,637 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8bcdb046-942e-11f0-89ef-024230831c95 2025-09-18 01:30:23,638 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8a2674bc-942e-11f0-89ef-024230831c95 2025-09-18 01:30:23,639 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8adcde96-942e-11f0-89ef-024230831c95 2025-09-18 01:30:23,640 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8c7a0bfc-942e-11f0-89ef-024230831c95 2025-09-18 01:30:28,639 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:28,641 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:28,642 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:28,643 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:33,653 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:33,655 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:33,656 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:33,657 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:38,669 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:38,671 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:38,672 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:38,674 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:43,685 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:43,686 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:43,687 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:43,688 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:48,700 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:48,702 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:48,703 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:48,704 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:53,716 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=26f002f4-956d-4e54-94e8-3e508c6494cc 2025-09-18 01:30:53,718 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=2d7c288b-b4c6-43ef-b142-7671bf59063d 2025-09-18 01:30:53,719 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=13d0571b-c87e-4847-bf4f-0d0bb6d974bf 2025-09-18 01:30:53,720 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=e4263e91-d845-4df4-8b8a-c3acc55d9d2b 2025-09-18 01:30:53,727 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8e100e30-942e-11f0-89ef-024230831c95 2025-09-18 01:30:53,734 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8d520606-942e-11f0-89ef-024230831c95 2025-09-18 01:30:53,741 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8f9a0d00-942e-11f0-89ef-024230831c95 2025-09-18 01:30:53,743 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ed1160c-942e-11f0-89ef-024230831c95