2026-02-09 21:41:52,011 - DEBUG - [10.0.0.242]: Running cmd : hostname 2026-02-09 21:41:52,282 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:52,282 - DEBUG - [10.0.0.242]: Running cmd : hostname -f 2026-02-09 21:41:52,310 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:52,310 - DEBUG - [10.0.0.242]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2026-02-09 21:41:52,411 - DEBUG - Output : NAMES compassionate_ellis contrail_test_aBJT9aJ64 contrail-kubernetes-master-kubemanager-1 webui-web-1 webui-job-1 control-named-1 control-dns-1 control-control-1 control-nodemgr-1 config_database-zookeeper-1 config_database-nodemgr-1 config_database-cassandra-1 config_database-rabbitmq-1 config_api-devicemgr-1 config_api-api-1 config_api-dnsmasq-1 config_api-svcmonitor-1 config_api-nodemgr-1 config_api-schema-1 redis-redis-1 analytics_snmp-topology-1 analytics_snmp-nodemgr-1 analytics_snmp-snmp-collector-1 analytics_alarm-alarm-gen-1 analytics_alarm-nodemgr-1 analytics_alarm-kafka-1 analytics-collector-1 analytics-nodemgr-1 analytics-api-1 analytics_database-nodemgr-1 analytics_database-cassandra-1 analytics_database-query-engine-1 2026-02-09 21:41:52,412 - DEBUG - [10.0.0.242]: Running cmd : ip -4 -o addr show | awk '{print $4}' 2026-02-09 21:41:52,456 - DEBUG - Output : 127.0.0.1/8 10.0.0.242/24 252.242.0.1/8 10.117.216.1/24 172.17.0.1/16 2026-02-09 21:41:52,456 - DEBUG - [10.0.0.242]: Running cmd : getent hosts 10.0.0.242 | head -n 1 | awk '{print $2}' 2026-02-09 21:41:52,490 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:52,578 - DEBUG - [10.0.0.129]: Running cmd : hostname 2026-02-09 21:41:52,796 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:52,796 - DEBUG - [10.0.0.129]: Running cmd : hostname -f 2026-02-09 21:41:52,821 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:52,821 - DEBUG - [10.0.0.129]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2026-02-09 21:41:52,906 - DEBUG - Output : NAMES vrouter-vrouter-agent-1 vrouter-nodemgr-1 2026-02-09 21:41:52,909 - DEBUG - [10.0.0.129]: Running cmd : ip -4 -o addr show dev vhost0 | awk '{print $4}' 2026-02-09 21:41:52,942 - DEBUG - Output : 10.0.0.129/24 2026-02-09 21:41:52,943 - DEBUG - [10.0.0.129]: Running cmd : getent hosts 10.0.0.129 | head -n 1 | awk '{print $2}' 2026-02-09 21:41:52,977 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-1866-1 2026-02-09 21:41:53,083 - INFO - Using existing project ['default-domain', 'k8s-default'](f182fa60-7a17-47f4-b96f-84c0c7fd5f2f) 2026-02-09 21:41:53,216 - INFO - Using existing project ['default-domain', 'k8s-default'](f182fa60-7a17-47f4-b96f-84c0c7fd5f2f) 2026-02-09 21:41:53,353 - INFO - ================================================================================ 2026-02-09 21:41:53,353 - INFO - STARTING TEST : test_ingress_ip_assignment 2026-02-09 21:41:53,354 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2026-02-09 21:41:53,558 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2026-02-09 21:41:53,565 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.242': '0'}} with 2026-02-09 21:41:53,565 - INFO - Initial checks done. Running the testcase now 2026-02-09 21:41:53,565 - INFO - 2026-02-09 21:41:53,569 - INFO - Namespace default already exists 2026-02-09 21:41:53,570 - DEBUG - [10.0.0.242]: Running cmd : docker exec --privileged -it contrail-kubernetes-master-kubemanager-1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2026-02-09 21:41:53,675 - DEBUG - Output : cluster_project={} 2026-02-09 21:41:53,719 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2026-02-09 21:41:53,719 - DEBUG - Project uuid in Contrail is f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:41:53,720 - DEBUG - [10.0.0.242]: Running cmd : docker exec --privileged -it contrail-kubernetes-master-kubemanager-1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2026-02-09 21:41:53,847 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2026-02-09 21:41:53,847 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_NamespaceDatabaseList?namespace_uuid=6f91ccc7-c216-48b5-b083-d7b99cb38204 2026-02-09 21:41:53,851 - INFO - Namespace default with uuid 6f91ccc7-c216-48b5-b083-d7b99cb38204 found in kube manager 2026-02-09 21:41:53,851 - INFO - Namespace default verification passed 2026-02-09 21:41:53,854 - DEBUG - Service ctest-nginx-svc-17909456 not present 2026-02-09 21:41:53,854 - INFO - Creating service ctest-nginx-svc-17909456 2026-02-09 21:41:53,875 - INFO - Created Service ctest-nginx-svc-17909456 2026-02-09 21:41:53,891 - DEBUG - Pod ctest-nginx-pod-05919218 not present 2026-02-09 21:41:53,891 - INFO - Creating Pod ctest-nginx-pod-05919218 2026-02-09 21:41:53,988 - DEBUG - Pod : ctest-nginx-pod-05919218 UUID is 9054a06d-e96b-4455-8b73-707f4c511fcf 2026-02-09 21:41:53,999 - DEBUG - Pod ctest-nginx-pod-11646818 not present 2026-02-09 21:41:54,000 - INFO - Creating Pod ctest-nginx-pod-11646818 2026-02-09 21:41:54,040 - DEBUG - Pod : ctest-nginx-pod-11646818 UUID is 877b58c5-a668-404f-89c9-b0160f15c15c 2026-02-09 21:41:54,218 - INFO - Created VN __public__, UUID :6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:54,435 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:41:54,440 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:41:54,455 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:41:54,513 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:54,522 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:54,532 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:54,537 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:54,542 - DEBUG - Route Targets: [] 2026-02-09 21:41:54,542 - DEBUG - RT names not yet present for VN __public__ 2026-02-09 21:41:59,543 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:41:59,548 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:41:59,556 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:41:59,607 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,622 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,637 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:59,648 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:59,659 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/313c95c2-536c-4e7a-bad9-d45226296863 2026-02-09 21:41:59,671 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-09 21:41:59,671 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,686 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:59,710 - INFO - Verified VN network id 13 for VN 6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,710 - INFO - Verifications in API Server for VN __public__ passed 2026-02-09 21:41:59,711 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,726 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:59,735 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:41:59,751 - DEBUG - Requesting: http://10.0.0.242:8082/route-target/313c95c2-536c-4e7a-bad9-d45226296863 2026-02-09 21:41:59,765 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2026-02-09 21:41:59,777 - DEBUG - Control-node 10.0.0.242 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7230302136404167381', 'uuid-lslong': '11134405775515370233'}, 'enable': 'true', 'created': '2026-02-09T21:41:54', 'last-modified': '2026-02-09T21:41:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.392936'} 2026-02-09 21:41:59,777 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:41:59,792 - DEBUG - Route Targets: ['target:64512:8000006'] 2026-02-09 21:41:59,792 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2026-02-09 21:41:59,792 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2026-02-09 21:41:59,792 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:41:59,797 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:41:59,819 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:41:59,897 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:41:59,907 - DEBUG - =>VN __public__ has no policy to be verified 2026-02-09 21:41:59,907 - DEBUG - Verifying the vn in opserver 2026-02-09 21:41:59,907 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.242 2026-02-09 21:41:59,907 - DEBUG - Requesting: http://10.0.0.242:8081/analytics/uves/virtual-networks 2026-02-09 21:41:59,912 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.242:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2026-02-09 21:41:59,912 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2026-02-09 21:41:59,912 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:41:59,920 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:41:59,926 - DEBUG - Do not have enough data to verify VN in agent 2026-02-09 21:41:59,927 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:41:59,936 - DEBUG - VRF ids for VN __public__: {} 2026-02-09 21:42:00,055 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2026-02-09 21:42:00,184 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:42:00,196 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:42:00,204 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:42:00,264 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:42:00,285 - DEBUG - Requesting: http://10.0.0.242:8082/floating-ip-pool/8486168d-ebd9-4099-9ab3-a6dcc70c2c6b 2026-02-09 21:42:00,291 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:42:00,297 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:42:00,307 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:42:00,362 - DEBUG - Requesting: http://10.0.0.242:8082/virtual-network/6457317c-3b1e-4ad5-9a85-5b0f6aa6c2f9 2026-02-09 21:42:00,374 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2026-02-09 21:42:00,374 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2026-02-09 21:42:00,388 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2026-02-09 21:42:00,395 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2026-02-09 21:42:00,395 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2026-02-09 21:42:00,398 - DEBUG - Ingress ctest-nginx-ingress-30015126 not present 2026-02-09 21:42:00,398 - INFO - Creating Ingress ctest-nginx-ingress-30015126 2026-02-09 21:42:00,407 - INFO - Created Ingress ctest-nginx-ingress-30015126 2026-02-09 21:42:00,412 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-30015126 2026-02-09 21:42:03,425 - DEBUG - For Ingress ctest-nginx-ingress-30015126, Cluster IP: 10.47.255.249, External IPs ['148.70.60.124'] 2026-02-09 21:42:03,425 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-30015126 2026-02-09 21:42:03,426 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_LoadbalancerDatabaseList?x=a030d9da-826a-4b01-af8c-4d6c1c7032cb 2026-02-09 21:42:03,432 - INFO - Ingress ctest-nginx-ingress-30015126 with uuid a030d9da-826a-4b01-af8c-4d6c1c7032cb found in kube manager 2026-02-09 21:42:03,432 - INFO - Ingress ctest-nginx-ingress-30015126 verification passed 2026-02-09 21:42:03,437 - DEBUG - Pod ctest-busybox-pod-16895738 not present 2026-02-09 21:42:03,437 - INFO - Creating Pod ctest-busybox-pod-16895738 2026-02-09 21:42:03,478 - DEBUG - Pod : ctest-busybox-pod-16895738 UUID is f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:03,499 - DEBUG - Pod ctest-nginx-pod-05919218 not in running state.Currently in Pending 2026-02-09 21:42:08,506 - DEBUG - Pod ctest-nginx-pod-05919218 not in running state.Currently in Pending 2026-02-09 21:42:13,513 - INFO - Pod ctest-nginx-pod-05919218 is in running state.Got IP 10.47.255.251 2026-02-09 21:42:13,568 - DEBUG - Pod ctest-nginx-pod-05919218 has vmi 275a9ea0-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:42:13,568 - INFO - Verified pod ctest-nginx-pod-05919218 in contrail-api 2026-02-09 21:42:13,568 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2026-02-09 21:42:13,581 - DEBUG - VMI 275a9ea0-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:42:13,581 - INFO - Verified Pod ctest-nginx-pod-05919218 in agent 10.0.0.129 2026-02-09 21:42:13,581 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=9054a06d-e96b-4455-8b73-707f4c511fcf 2026-02-09 21:42:13,585 - INFO - Pod ctest-nginx-pod-05919218 with uuid 9054a06d-e96b-4455-8b73-707f4c511fcf found in kube manager 2026-02-09 21:42:13,585 - INFO - Pod ctest-nginx-pod-05919218 verification passed 2026-02-09 21:42:13,673 - DEBUG - [Pod ctest-nginx-pod-05919218] Cmd: echo ctest-nginx-pod-05919218 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:42:13,679 - INFO - Pod ctest-nginx-pod-11646818 is in running state.Got IP 10.47.255.250 2026-02-09 21:42:13,690 - DEBUG - Pod ctest-nginx-pod-11646818 has vmi 27b289d0-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:42:13,690 - INFO - Verified pod ctest-nginx-pod-11646818 in contrail-api 2026-02-09 21:42:13,690 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2026-02-09 21:42:13,700 - DEBUG - VMI 27b289d0-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:42:13,701 - INFO - Verified Pod ctest-nginx-pod-11646818 in agent 10.0.0.129 2026-02-09 21:42:13,701 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=877b58c5-a668-404f-89c9-b0160f15c15c 2026-02-09 21:42:13,704 - INFO - Pod ctest-nginx-pod-11646818 with uuid 877b58c5-a668-404f-89c9-b0160f15c15c found in kube manager 2026-02-09 21:42:13,704 - INFO - Pod ctest-nginx-pod-11646818 verification passed 2026-02-09 21:42:13,757 - DEBUG - [Pod ctest-nginx-pod-11646818] Cmd: echo ctest-nginx-pod-11646818 > /usr/share/nginx/html/index.html, Output: 2026-02-09 21:42:13,763 - DEBUG - Pod ctest-busybox-pod-16895738 not in running state.Currently in Pending 2026-02-09 21:42:18,770 - INFO - Pod ctest-busybox-pod-16895738 is in running state.Got IP 10.47.255.248 2026-02-09 21:42:18,781 - DEBUG - Pod ctest-busybox-pod-16895738 has vmi 2c3880b8-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:42:18,781 - INFO - Verified pod ctest-busybox-pod-16895738 in contrail-api 2026-02-09 21:42:18,781 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2026-02-09 21:42:18,791 - DEBUG - VMI 2c3880b8-0600-11f1-a42f-fa163e4ce2ba is active in agent 10.0.0.129 2026-02-09 21:42:18,791 - INFO - Verified Pod ctest-busybox-pod-16895738 in agent 10.0.0.129 2026-02-09 21:42:18,791 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_VirtualMachineDatabaseList?x=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:18,794 - INFO - Pod ctest-busybox-pod-16895738 with uuid f3992c62-7d9c-4959-8422-8625d9543da3 found in kube manager 2026-02-09 21:42:18,795 - INFO - Pod ctest-busybox-pod-16895738 verification passed 2026-02-09 21:42:18,845 - DEBUG - [Pod ctest-busybox-pod-16895738] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-05919218 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2026-02-09 21:42:18,845 - DEBUG - [Pod Pod ctest-busybox-pod-16895738] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2026-02-09 21:42:18,845 - DEBUG - [Pod Pod ctest-busybox-pod-16895738] Cmd output: ctest-nginx-pod-05919218 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2026-02-09 21:42:18,901 - DEBUG - [Pod ctest-busybox-pod-16895738] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-11646818 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2026-02-09 21:42:18,901 - DEBUG - [Pod Pod ctest-busybox-pod-16895738] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2026-02-09 21:42:18,901 - DEBUG - [Pod Pod ctest-busybox-pod-16895738] Cmd output: ctest-nginx-pod-11646818 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2026-02-09 21:42:18,901 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-05919218': 1, 'ctest-nginx-pod-11646818': 1} 2026-02-09 21:42:18,901 - WARNING - Nothing to delete parallely 2026-02-09 21:42:18,901 - INFO - Deleting pod default:ctest-busybox-pod-16895738 2026-02-09 21:42:18,915 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:18,921 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:23,921 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:23,929 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:28,929 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:28,936 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:33,937 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:33,945 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:38,946 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:38,955 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:43,956 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:43,966 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:48,967 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:48,973 - WARNING - Pod uuid f3992c62-7d9c-4959-8422-8625d9543da3 is still seen in agent 10.0.0.129 VM list 2026-02-09 21:42:53,974 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=f3992c62-7d9c-4959-8422-8625d9543da3 2026-02-09 21:42:53,980 - DEBUG - Pod f3992c62-7d9c-4959-8422-8625d9543da3 is not in agent 10.0.0.129 VM list 2026-02-09 21:42:53,980 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:2c3880b8-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:42:53,986 - DEBUG - VMI 2c3880b8-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:42:53,986 - INFO - Verified that pod ctest-busybox-pod-16895738 is removed in agent 2026-02-09 21:42:53,986 - INFO - Deleting Ingress : ctest-nginx-ingress-30015126 2026-02-09 21:42:53,992 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_LoadbalancerDatabaseList?x=a030d9da-826a-4b01-af8c-4d6c1c7032cb 2026-02-09 21:42:54,001 - ERROR - Ingress ctest-nginx-ingress-30015126 with uuid a030d9da-826a-4b01-af8c-4d6c1c7032cb still found in kube manager 2026-02-09 21:42:55,002 - DEBUG - Requesting: http://10.0.0.242:8108/Snh_LoadbalancerDatabaseList?x=a030d9da-826a-4b01-af8c-4d6c1c7032cb 2026-02-09 21:42:55,008 - INFO - Ingress ctest-nginx-ingress-30015126 with uuid a030d9da-826a-4b01-af8c-4d6c1c7032cb deleted successfully from kube manager 2026-02-09 21:42:55,009 - INFO - Verifications on Ingress %s cleanup passed 2026-02-09 21:42:55,009 - INFO - Deleting the FIP pool __fip_pool_public__ 2026-02-09 21:42:55,107 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2026-02-09 21:42:55,111 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2026-02-09 21:42:55,112 - INFO - Deleting VN __public__ 2026-02-09 21:42:55,228 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/8e00495c-d2ba-4478-a67d-69782807e03f 2026-02-09 21:42:55,234 - DEBUG - Response Code: 404 2026-02-09 21:42:55,234 - DEBUG - Requesting: http://10.0.0.242:8082/domains 2026-02-09 21:42:55,239 - DEBUG - Requesting: http://10.0.0.242:8082/domain/075d6eb9-4aef-48c5-98ba-c95240a2d31f 2026-02-09 21:42:55,251 - DEBUG - Requesting: http://10.0.0.242:8082/project/f182fa60-7a17-47f4-b96f-84c0c7fd5f2f 2026-02-09 21:42:55,291 - INFO - Validated that VN __public__ is not found in API Server 2026-02-09 21:42:55,291 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2026-02-09 21:42:55,299 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:42:55,310 - DEBUG - VN __public__ is not present in Agent 10.0.0.129 2026-02-09 21:42:55,310 - INFO - Validated that VN __public__ is not in any agent 2026-02-09 21:42:55,311 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:42:55,318 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2026-02-09 21:42:55,328 - DEBUG - Requesting: http://10.0.0.242:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2026-02-09 21:42:55,335 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2026-02-09 21:42:55,335 - INFO - Deleting pod default:ctest-nginx-pod-11646818 2026-02-09 21:42:55,351 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=877b58c5-a668-404f-89c9-b0160f15c15c 2026-02-09 21:42:55,362 - WARNING - Pod uuid 877b58c5-a668-404f-89c9-b0160f15c15c is still seen in agent 10.0.0.129 VM list 2026-02-09 21:43:00,363 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=877b58c5-a668-404f-89c9-b0160f15c15c 2026-02-09 21:43:00,369 - DEBUG - Pod 877b58c5-a668-404f-89c9-b0160f15c15c is not in agent 10.0.0.129 VM list 2026-02-09 21:43:00,369 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:27b289d0-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:00,373 - DEBUG - VMI 27b289d0-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:43:00,373 - INFO - Verified that pod ctest-nginx-pod-11646818 is removed in agent 2026-02-09 21:43:00,374 - INFO - Deleting pod default:ctest-nginx-pod-05919218 2026-02-09 21:43:00,385 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=9054a06d-e96b-4455-8b73-707f4c511fcf 2026-02-09 21:43:00,392 - WARNING - Pod uuid 9054a06d-e96b-4455-8b73-707f4c511fcf is still seen in agent 10.0.0.129 VM list 2026-02-09 21:43:05,393 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_VmListReq?uuid=9054a06d-e96b-4455-8b73-707f4c511fcf 2026-02-09 21:43:05,413 - DEBUG - Pod 9054a06d-e96b-4455-8b73-707f4c511fcf is not in agent 10.0.0.129 VM list 2026-02-09 21:43:05,414 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:275a9ea0-0600-11f1-a42f-fa163e4ce2ba 2026-02-09 21:43:05,419 - DEBUG - VMI 275a9ea0-0600-11f1-a42f-fa163e4ce2ba is removed from agent 10.0.0.129 2026-02-09 21:43:05,419 - INFO - Verified that pod ctest-nginx-pod-05919218 is removed in agent 2026-02-09 21:43:05,420 - INFO - Deleting service : ctest-nginx-svc-17909456 2026-02-09 21:43:05,592 - DEBUG - Requesting: http://10.0.0.129:8085/Snh_AgentXmppConnectionStatusReq? 2026-02-09 21:43:05,598 - DEBUG - No XMPP flaps were noticed during the test