2025-03-28 23:08:07,913 - INFO - Using existing project ['default-domain', 'k8s-default'](f0e166a7-6a9c-492c-b106-1aafc60385b9) 2025-03-28 23:08:07,931 - DEBUG - Namespace ctest-new-default-76643658 not present 2025-03-28 23:08:07,948 - INFO - Created namespace ctest-new-default-76643658 2025-03-28 23:08:10,953 - DEBUG - Namespace ctest-non-default-75057733 not present 2025-03-28 23:08:10,966 - INFO - Created namespace ctest-non-default-75057733 2025-03-28 23:08:13,994 - DEBUG - Pod ctest-pod-38955661 not present 2025-03-28 23:08:13,995 - INFO - Creating Pod ctest-pod-38955661 2025-03-28 23:08:14,016 - DEBUG - Pod : ctest-pod-38955661 UUID is 61d75691-55c5-4914-926f-c9f6304054af 2025-03-28 23:08:14,021 - DEBUG - Pod ctest-pod-69973020 not present 2025-03-28 23:08:14,021 - INFO - Creating Pod ctest-pod-69973020 2025-03-28 23:08:14,045 - DEBUG - Pod : ctest-pod-69973020 UUID is c11cd77b-b142-4114-8116-28c0905a568d 2025-03-28 23:08:14,049 - DEBUG - Pod ctest-pod-70109243 not present 2025-03-28 23:08:14,050 - INFO - Creating Pod ctest-pod-70109243 2025-03-28 23:08:14,099 - DEBUG - Pod : ctest-pod-70109243 UUID is 2bf1e578-4abb-43f6-9626-13193e4e44f1 2025-03-28 23:08:14,102 - DEBUG - Pod ctest-pod-52056915 not present 2025-03-28 23:08:14,103 - INFO - Creating Pod ctest-pod-52056915 2025-03-28 23:08:14,153 - DEBUG - Pod : ctest-pod-52056915 UUID is fd968a8a-ca55-450b-8942-57615add2ab0 2025-03-28 23:08:14,156 - DEBUG - Pod ctest-pod-61380233 not present 2025-03-28 23:08:14,156 - INFO - Creating Pod ctest-pod-61380233 2025-03-28 23:08:14,179 - DEBUG - Pod : ctest-pod-61380233 UUID is 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b 2025-03-28 23:08:14,182 - DEBUG - Pod ctest-pod-02045800 not present 2025-03-28 23:08:14,183 - INFO - Creating Pod ctest-pod-02045800 2025-03-28 23:08:14,204 - DEBUG - Pod : ctest-pod-02045800 UUID is 7c926d41-4bff-4b36-8f19-9fb167cd5e85 2025-03-28 23:08:14,207 - DEBUG - Pod ctest-pod-65214922 not present 2025-03-28 23:08:14,207 - INFO - Creating Pod ctest-pod-65214922 2025-03-28 23:08:14,229 - DEBUG - Pod : ctest-pod-65214922 UUID is c2a21677-b9e1-4163-bd2e-812538eec740 2025-03-28 23:08:14,231 - DEBUG - Pod ctest-pod-16204701 not present 2025-03-28 23:08:14,232 - INFO - Creating Pod ctest-pod-16204701 2025-03-28 23:08:14,250 - DEBUG - Pod : ctest-pod-16204701 UUID is 142fe3df-d3b5-47c2-bfec-74bc88a52885 2025-03-28 23:08:14,459 - INFO - Project default-domain:k8s-ctest-new-default-76643658 for Namespace ctest-new-default-76643658 is seen in contrail-api 2025-03-28 23:08:14,460 - DEBUG - Project uuid in Contrail is b017d8b6-bb14-4236-a621-b1dae8123cf0 2025-03-28 23:08:14,665 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=3288b791-c29f-42c9-a144-81af50588e30 2025-03-28 23:08:14,671 - INFO - Namespace ctest-new-default-76643658 with uuid 3288b791-c29f-42c9-a144-81af50588e30 found in kube manager 2025-03-28 23:08:14,671 - INFO - Namespace ctest-new-default-76643658 verification passed 2025-03-28 23:08:14,910 - INFO - Project default-domain:k8s-ctest-non-default-75057733 for Namespace ctest-non-default-75057733 is seen in contrail-api 2025-03-28 23:08:14,910 - DEBUG - Project uuid in Contrail is 045e6569-aaf8-4fc1-b137-ca5d1bbf7f80 2025-03-28 23:08:14,911 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=599bd5fc-ca50-46a1-ae15-a624aa3bfab7 2025-03-28 23:08:14,920 - INFO - Namespace ctest-non-default-75057733 with uuid 599bd5fc-ca50-46a1-ae15-a624aa3bfab7 found in kube manager 2025-03-28 23:08:14,920 - INFO - Namespace ctest-non-default-75057733 verification passed 2025-03-28 23:08:14,927 - DEBUG - Pod ctest-pod-38955661 not in running state.Currently in Pending 2025-03-28 23:08:19,935 - DEBUG - Pod ctest-pod-38955661 not in running state.Currently in Pending 2025-03-28 23:08:24,943 - DEBUG - Pod ctest-pod-38955661 not in running state.Currently in Pending 2025-03-28 23:08:29,959 - INFO - Pod ctest-pod-38955661 is in running state.Got IP 10.47.255.251 2025-03-28 23:08:29,983 - DEBUG - Pod ctest-pod-38955661 has vmi 87bf4a24-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:29,983 - INFO - Verified pod ctest-pod-38955661 in contrail-api 2025-03-28 23:08:30,004 - DEBUG - VMI 87bf4a24-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:30,006 - INFO - Verified Pod ctest-pod-38955661 in agent 10.0.0.17 2025-03-28 23:08:30,006 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=61d75691-55c5-4914-926f-c9f6304054af 2025-03-28 23:08:30,017 - INFO - Pod ctest-pod-38955661 with uuid 61d75691-55c5-4914-926f-c9f6304054af found in kube manager 2025-03-28 23:08:30,017 - INFO - Pod ctest-pod-38955661 verification passed 2025-03-28 23:08:30,031 - INFO - Pod ctest-pod-69973020 is in running state.Got IP 10.47.255.250 2025-03-28 23:08:30,050 - DEBUG - Pod ctest-pod-69973020 has vmi 8840f2fe-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:30,050 - INFO - Verified pod ctest-pod-69973020 in contrail-api 2025-03-28 23:08:30,073 - DEBUG - VMI 8840f2fe-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:30,073 - INFO - Verified Pod ctest-pod-69973020 in agent 10.0.0.17 2025-03-28 23:08:30,073 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=c11cd77b-b142-4114-8116-28c0905a568d 2025-03-28 23:08:30,079 - INFO - Pod ctest-pod-69973020 with uuid c11cd77b-b142-4114-8116-28c0905a568d found in kube manager 2025-03-28 23:08:30,079 - INFO - Pod ctest-pod-69973020 verification passed 2025-03-28 23:08:30,086 - INFO - Pod ctest-pod-70109243 is in running state.Got IP 10.47.255.249 2025-03-28 23:08:30,147 - DEBUG - Pod ctest-pod-70109243 has vmi 88fc5e72-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:30,147 - INFO - Verified pod ctest-pod-70109243 in contrail-api 2025-03-28 23:08:30,168 - DEBUG - VMI 88fc5e72-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:30,169 - INFO - Verified Pod ctest-pod-70109243 in agent 10.0.0.17 2025-03-28 23:08:30,169 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=2bf1e578-4abb-43f6-9626-13193e4e44f1 2025-03-28 23:08:30,174 - INFO - Pod ctest-pod-70109243 with uuid 2bf1e578-4abb-43f6-9626-13193e4e44f1 found in kube manager 2025-03-28 23:08:30,174 - INFO - Pod ctest-pod-70109243 verification passed 2025-03-28 23:08:30,181 - INFO - Pod ctest-pod-52056915 is in running state.Got IP 10.47.255.248 2025-03-28 23:08:30,197 - DEBUG - Pod ctest-pod-52056915 has vmi 8980ecd2-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:30,197 - INFO - Verified pod ctest-pod-52056915 in contrail-api 2025-03-28 23:08:30,218 - DEBUG - VMI 8980ecd2-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:30,219 - INFO - Verified Pod ctest-pod-52056915 in agent 10.0.0.17 2025-03-28 23:08:30,219 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=fd968a8a-ca55-450b-8942-57615add2ab0 2025-03-28 23:08:30,227 - INFO - Pod ctest-pod-52056915 with uuid fd968a8a-ca55-450b-8942-57615add2ab0 found in kube manager 2025-03-28 23:08:30,227 - INFO - Pod ctest-pod-52056915 verification passed 2025-03-28 23:08:30,235 - INFO - Pod ctest-pod-61380233 is in running state.Got IP 10.47.255.247 2025-03-28 23:08:30,302 - DEBUG - Pod ctest-pod-61380233 has vmi 8a224bc2-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:30,303 - INFO - Verified pod ctest-pod-61380233 in contrail-api 2025-03-28 23:08:30,325 - DEBUG - VMI 8a224bc2-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:30,326 - INFO - Verified Pod ctest-pod-61380233 in agent 10.0.0.17 2025-03-28 23:08:30,326 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b 2025-03-28 23:08:30,333 - INFO - Pod ctest-pod-61380233 with uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b found in kube manager 2025-03-28 23:08:30,334 - INFO - Pod ctest-pod-61380233 verification passed 2025-03-28 23:08:30,341 - DEBUG - Pod ctest-pod-65214922 not in running state.Currently in Pending 2025-03-28 23:08:35,348 - INFO - Pod ctest-pod-65214922 is in running state.Got IP 10.47.255.245 2025-03-28 23:08:35,363 - DEBUG - Pod ctest-pod-65214922 has vmi 8b382d60-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:35,364 - INFO - Verified pod ctest-pod-65214922 in contrail-api 2025-03-28 23:08:35,380 - DEBUG - VMI 8b382d60-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:35,380 - INFO - Verified Pod ctest-pod-65214922 in agent 10.0.0.17 2025-03-28 23:08:35,380 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=c2a21677-b9e1-4163-bd2e-812538eec740 2025-03-28 23:08:35,385 - INFO - Pod ctest-pod-65214922 with uuid c2a21677-b9e1-4163-bd2e-812538eec740 found in kube manager 2025-03-28 23:08:35,385 - INFO - Pod ctest-pod-65214922 verification passed 2025-03-28 23:08:35,468 - INFO - Pod ctest-pod-02045800 is in running state.Got IP 10.47.255.246 2025-03-28 23:08:35,484 - DEBUG - Pod ctest-pod-02045800 has vmi 8aaf2be6-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:35,484 - INFO - Verified pod ctest-pod-02045800 in contrail-api 2025-03-28 23:08:35,505 - DEBUG - VMI 8aaf2be6-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:35,505 - INFO - Verified Pod ctest-pod-02045800 in agent 10.0.0.17 2025-03-28 23:08:35,506 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=7c926d41-4bff-4b36-8f19-9fb167cd5e85 2025-03-28 23:08:35,512 - INFO - Pod ctest-pod-02045800 with uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 found in kube manager 2025-03-28 23:08:35,512 - INFO - Pod ctest-pod-02045800 verification passed 2025-03-28 23:08:35,518 - INFO - Pod ctest-pod-16204701 is in running state.Got IP 10.47.255.244 2025-03-28 23:08:35,576 - DEBUG - Pod ctest-pod-16204701 has vmi 8bc0c080-0c29-11f0-b16e-fa163e20b9b5 2025-03-28 23:08:35,576 - INFO - Verified pod ctest-pod-16204701 in contrail-api 2025-03-28 23:08:35,591 - DEBUG - VMI 8bc0c080-0c29-11f0-b16e-fa163e20b9b5 is active in agent 10.0.0.17 2025-03-28 23:08:35,592 - INFO - Verified Pod ctest-pod-16204701 in agent 10.0.0.17 2025-03-28 23:08:35,592 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=142fe3df-d3b5-47c2-bfec-74bc88a52885 2025-03-28 23:08:35,597 - INFO - Pod ctest-pod-16204701 with uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 found in kube manager 2025-03-28 23:08:35,598 - INFO - Pod ctest-pod-16204701 verification passed 2025-03-28 23:08:35,598 - INFO - ================================================================================ 2025-03-28 23:08:35,598 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-28 23:08:35,598 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-28 23:08:35,829 - DEBUG - Nothing to compare xmpp stats {'10.0.0.17': {'10.0.0.40': '0'}} with 2025-03-28 23:08:35,829 - INFO - Initial checks done. Running the testcase now 2025-03-28 23:08:35,829 - INFO - 2025-03-28 23:08:35,891 - DEBUG - [Pod ctest-pod-38955661] Cmd: echo ctest-pod-38955661 > /usr/share/nginx/html/index.html, Output: 2025-03-28 23:08:35,960 - DEBUG - [Pod ctest-pod-69973020] Cmd: echo ctest-pod-69973020 > /usr/share/nginx/html/index.html, Output: 2025-03-28 23:08:36,025 - DEBUG - [Pod ctest-pod-70109243] Cmd: echo ctest-pod-70109243 > /usr/share/nginx/html/index.html, Output: 2025-03-28 23:08:36,086 - DEBUG - [Pod ctest-pod-52056915] Cmd: echo ctest-pod-52056915 > /usr/share/nginx/html/index.html, Output: 2025-03-28 23:08:36,091 - DEBUG - Service ctest-nginx-svc-89418514 not present 2025-03-28 23:08:36,091 - INFO - Creating service ctest-nginx-svc-89418514 2025-03-28 23:08:36,113 - INFO - Created Service ctest-nginx-svc-89418514 2025-03-28 23:08:36,120 - WARNING - Service UUID 0b1ad595-e7eb-4b42-b0ea-93799f0b6f34 not yet found in contrail-api 2025-03-28 23:08:37,131 - INFO - Validated that Service ctest-nginx-svc-89418514 is seen in contrail-api 2025-03-28 23:08:37,131 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_LoadbalancerDatabaseList?x=0b1ad595-e7eb-4b42-b0ea-93799f0b6f34 2025-03-28 23:08:37,138 - INFO - Service ctest-nginx-svc-89418514 with uuid 0b1ad595-e7eb-4b42-b0ea-93799f0b6f34 found in kube manager 2025-03-28 23:08:37,138 - INFO - Service ctest-nginx-svc-89418514 verification passed 2025-03-28 23:08:38,226 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) ctest-pod-69973020 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,226 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,226 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) ctest-pod-69973020 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,288 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69973020 2025-03-28 23:08:38,289 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,289 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69973020 2025-03-28 23:08:38,356 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,357 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,357 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,428 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,429 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,429 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,429 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38955661': 1, 'ctest-pod-69973020': 3} 2025-03-28 23:08:38,500 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69973020 2025-03-28 23:08:38,500 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,500 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69973020 2025-03-28 23:08:38,573 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,574 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:08:38,574 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:08:38,574 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38955661': 1, 'ctest-pod-69973020': 1} 2025-03-28 23:08:38,578 - DEBUG - Network policy ingress-on-service not present 2025-03-28 23:08:38,578 - INFO - Creating Network Policy ingress-on-service 2025-03-28 23:08:38,608 - INFO - Network policy found in k8s 2025-03-28 23:08:38,608 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=440cab38-54b4-4e93-9591-41ca46e78dbb 2025-03-28 23:08:38,613 - INFO - Network Policy ingress-on-service with uuid 440cab38-54b4-4e93-9591-41ca46e78dbb found in kube manager 2025-03-28 23:08:38,652 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-28 23:08:38,652 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-28 23:08:38,652 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=440cab38-54b4-4e93-9591-41ca46e78dbb 2025-03-28 23:08:38,686 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-28 23:08:40,687 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=440cab38-54b4-4e93-9591-41ca46e78dbb 2025-03-28 23:08:40,718 - INFO - Network policy with name ingress-on-service found in agent 2025-03-28 23:08:40,719 - INFO - Network Policy ingress-on-service verification passed 2025-03-28 23:08:45,786 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:45,786 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:45,786 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:50,855 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:50,855 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:50,855 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:55,931 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:55,931 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:08:55,931 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:00,991 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:00,991 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:00,991 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:06,051 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:06,051 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:06,051 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:11,106 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:11,106 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:11,106 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:16,175 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:16,175 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:16,175 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:21,227 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:21,227 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:21,227 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:26,292 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:26,293 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:26,293 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:31,364 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:31,364 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:31,364 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:31,364 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38955661': 0, 'ctest-pod-69973020': 0} 2025-03-28 23:09:31,441 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:09:31,441 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:09:31,441 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:09:31,500 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) ctest-pod-38955661 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:09:31,501 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:09:31,501 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) ctest-pod-38955661 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:09:31,501 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38955661': 1, 'ctest-pod-69973020': 1} 2025-03-28 23:09:36,575 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:36,575 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:36,575 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:41,640 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:41,640 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:41,640 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:46,690 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:46,691 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:46,691 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:51,737 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:51,737 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:51,737 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:56,800 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:56,800 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:09:56,800 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:01,853 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:01,853 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:01,853 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:06,915 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:06,916 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:06,916 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:11,980 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:11,980 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:11,980 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:17,036 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:17,036 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:17,036 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:22,106 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:22,106 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:22,106 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:22,106 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38955661': 0, 'ctest-pod-69973020': 0} 2025-03-28 23:10:24,172 - DEBUG - [Pod ctest-pod-02045800] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.238 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.469/1.238 ms 2025-03-28 23:10:24,172 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-02045800 with expectation True passed 2025-03-28 23:10:26,236 - DEBUG - [Pod ctest-pod-61380233] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.774 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.316/0.774 ms 2025-03-28 23:10:26,236 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61380233 with expectation True passed 2025-03-28 23:10:28,292 - DEBUG - [Pod ctest-pod-65214922] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.194 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.447/1.194 ms 2025-03-28 23:10:28,292 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65214922 with expectation True passed 2025-03-28 23:10:28,358 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:10:28,358 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-28 23:10:28,359 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:10:28,359 - INFO - wget check of of http://10.47.255.251 from ctest-pod-02045800 passed 2025-03-28 23:10:28,425 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:10:28,425 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-28 23:10:28,425 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:10:28,425 - INFO - wget check of of http://10.47.255.250 from ctest-pod-02045800 passed 2025-03-28 23:10:33,480 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:10:33,480 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:10:33,480 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:10:33,480 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61380233 passed 2025-03-28 23:10:38,558 - DEBUG - [Pod ctest-pod-16204701] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-28 23:10:38,559 - DEBUG - [Pod Pod ctest-pod-16204701] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-28 23:10:38,559 - DEBUG - [Pod Pod ctest-pod-16204701] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-28 23:10:38,559 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16204701 passed 2025-03-28 23:10:38,570 - INFO - Updating Network Policy ingress-on-service 2025-03-28 23:10:43,648 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:43,648 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:43,648 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:48,704 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:48,704 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:48,704 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:53,779 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:53,779 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:53,779 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:58,848 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:58,848 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:10:58,848 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:03,910 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:03,910 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:03,911 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:08,966 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:08,966 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:08,967 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:14,024 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:14,025 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:14,025 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:15,430 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-03-28 23:11:25,504 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:25,504 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:25,504 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:30,581 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:30,581 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:30,581 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:35,647 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:35,647 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:35,647 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.111.220.76:80 (10.111.220.76:80) wget: download timed out 2025-03-28 23:11:35,647 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38955661': 0, 'ctest-pod-69973020': 0} 2025-03-28 23:11:35,730 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,730 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:11:35,730 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,780 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,781 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:11:35,781 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,781 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38955661': 1, 'ctest-pod-69973020': 1} 2025-03-28 23:11:35,849 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,849 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:11:35,849 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: ctest-pod-38955661 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,925 - DEBUG - [Pod ctest-pod-65214922] Cmd: wget http://10.111.220.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,925 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd wget http://10.111.220.76:80/ -O - -T 5 -t 1 passed 2025-03-28 23:11:35,925 - DEBUG - [Pod Pod ctest-pod-65214922] Cmd output: ctest-pod-69973020 Connecting to 10.111.220.76:80 (10.111.220.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-28 23:11:35,925 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38955661': 1, 'ctest-pod-69973020': 1} 2025-03-28 23:11:38,002 - DEBUG - [Pod ctest-pod-02045800] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.982 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.375/0.982 ms 2025-03-28 23:11:38,003 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-02045800 with expectation True passed 2025-03-28 23:11:40,060 - DEBUG - [Pod ctest-pod-61380233] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.745 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.303/0.745 ms 2025-03-28 23:11:40,060 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61380233 with expectation True passed 2025-03-28 23:11:42,133 - DEBUG - [Pod ctest-pod-65214922] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.434 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.196/0.434 ms 2025-03-28 23:11:42,133 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65214922 with expectation True passed 2025-03-28 23:11:42,191 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:42,191 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-28 23:11:42,192 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:42,192 - INFO - wget check of of http://10.47.255.251 from ctest-pod-02045800 passed 2025-03-28 23:11:42,249 - DEBUG - [Pod ctest-pod-02045800] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:42,250 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-28 23:11:42,250 - DEBUG - [Pod Pod ctest-pod-02045800] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:42,250 - INFO - wget check of of http://10.47.255.250 from ctest-pod-02045800 passed 2025-03-28 23:11:47,318 - DEBUG - [Pod ctest-pod-61380233] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:11:47,318 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:11:47,319 - DEBUG - [Pod Pod ctest-pod-61380233] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-28 23:11:47,319 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61380233 passed 2025-03-28 23:11:47,393 - DEBUG - [Pod ctest-pod-16204701] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:47,394 - DEBUG - [Pod Pod ctest-pod-16204701] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-28 23:11:47,394 - DEBUG - [Pod Pod ctest-pod-16204701] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-28 23:11:47,394 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16204701 passed 2025-03-28 23:11:47,394 - INFO - Deleting Network Policy : ingress-on-service 2025-03-28 23:11:47,395 - INFO - Deleting service : ctest-nginx-svc-89418514 2025-03-28 23:11:47,588 - DEBUG - No XMPP flaps were noticed during the test 2025-03-28 23:11:47,588 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-03-28 23:11:47,588 - INFO - -------------------------------------------------------------------------------- 2025-03-28 23:11:47,595 - INFO - Deleting pod ctest-new-default-76643658:ctest-pod-38955661 2025-03-28 23:11:47,597 - INFO - Deleting pod ctest-new-default-76643658:ctest-pod-69973020 2025-03-28 23:11:47,597 - INFO - Deleting pod ctest-non-default-75057733:ctest-pod-70109243 2025-03-28 23:11:47,598 - INFO - Deleting pod ctest-non-default-75057733:ctest-pod-52056915 2025-03-28 23:11:47,598 - INFO - Deleting pod ctest-new-default-76643658:ctest-pod-61380233 2025-03-28 23:11:47,598 - INFO - Deleting pod ctest-new-default-76643658:ctest-pod-02045800 2025-03-28 23:11:47,599 - INFO - Deleting pod ctest-non-default-75057733:ctest-pod-65214922 2025-03-28 23:11:47,599 - INFO - Deleting pod ctest-non-default-75057733:ctest-pod-16204701 2025-03-28 23:11:47,855 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,864 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,865 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,880 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,886 - WARNING - Pod uuid 61d75691-55c5-4914-926f-c9f6304054af is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,886 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,887 - WARNING - Pod uuid fd968a8a-ca55-450b-8942-57615add2ab0 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:47,887 - WARNING - Pod uuid 2bf1e578-4abb-43f6-9626-13193e4e44f1 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,864 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,876 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,878 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,893 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,905 - DEBUG - Pod fd968a8a-ca55-450b-8942-57615add2ab0 is not in agent 10.0.0.17 VM list 2025-03-28 23:11:52,907 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:52,907 - DEBUG - Pod 61d75691-55c5-4914-926f-c9f6304054af is not in agent 10.0.0.17 VM list 2025-03-28 23:11:52,910 - DEBUG - Pod 2bf1e578-4abb-43f6-9626-13193e4e44f1 is not in agent 10.0.0.17 VM list 2025-03-28 23:11:52,921 - DEBUG - VMI 8980ecd2-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:11:52,921 - INFO - Verified that pod ctest-pod-52056915 is removed in agent 2025-03-28 23:11:52,923 - DEBUG - VMI 87bf4a24-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:11:52,923 - INFO - Verified that pod ctest-pod-38955661 is removed in agent 2025-03-28 23:11:52,923 - DEBUG - VMI 88fc5e72-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:11:52,923 - INFO - Verified that pod ctest-pod-70109243 is removed in agent 2025-03-28 23:11:57,874 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:57,889 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:57,890 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:57,902 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:11:57,915 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:02,886 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:02,910 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:02,911 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:02,919 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:02,925 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:07,897 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:07,923 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:07,928 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:07,929 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:07,934 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:12,907 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:12,934 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:12,944 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:12,944 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:12,945 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:17,916 - WARNING - Pod uuid 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:17,954 - WARNING - Pod uuid 142fe3df-d3b5-47c2-bfec-74bc88a52885 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:17,958 - WARNING - Pod uuid 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:17,963 - WARNING - Pod uuid c2a21677-b9e1-4163-bd2e-812538eec740 is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:17,965 - WARNING - Pod uuid c11cd77b-b142-4114-8116-28c0905a568d is still seen in agent 10.0.0.17 VM list 2025-03-28 23:12:22,933 - DEBUG - Pod 34ff7ae4-ad8b-4f49-bdb3-0c4952bc830b is not in agent 10.0.0.17 VM list 2025-03-28 23:12:22,941 - DEBUG - VMI 8a224bc2-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:12:22,941 - INFO - Verified that pod ctest-pod-61380233 is removed in agent 2025-03-28 23:12:22,976 - DEBUG - Pod c11cd77b-b142-4114-8116-28c0905a568d is not in agent 10.0.0.17 VM list 2025-03-28 23:12:22,980 - DEBUG - Pod 7c926d41-4bff-4b36-8f19-9fb167cd5e85 is not in agent 10.0.0.17 VM list 2025-03-28 23:12:22,981 - DEBUG - Pod 142fe3df-d3b5-47c2-bfec-74bc88a52885 is not in agent 10.0.0.17 VM list 2025-03-28 23:12:22,982 - DEBUG - Pod c2a21677-b9e1-4163-bd2e-812538eec740 is not in agent 10.0.0.17 VM list 2025-03-28 23:12:22,998 - DEBUG - VMI 8b382d60-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:12:22,998 - INFO - Verified that pod ctest-pod-65214922 is removed in agent 2025-03-28 23:12:22,999 - DEBUG - VMI 8840f2fe-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:12:22,999 - INFO - Verified that pod ctest-pod-69973020 is removed in agent 2025-03-28 23:12:23,007 - DEBUG - VMI 8bc0c080-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:12:23,007 - INFO - Verified that pod ctest-pod-16204701 is removed in agent 2025-03-28 23:12:23,008 - DEBUG - VMI 8aaf2be6-0c29-11f0-b16e-fa163e20b9b5 is removed from agent 10.0.0.17 2025-03-28 23:12:23,008 - INFO - Verified that pod ctest-pod-02045800 is removed in agent 2025-03-28 23:12:23,008 - INFO - Deleting namespace ctest-non-default-75057733 2025-03-28 23:12:23,020 - DEBUG - Namespace ctest-non-default-75057733 still in k8s 2025-03-28 23:12:25,025 - DEBUG - Namespace ctest-non-default-75057733 still in k8s 2025-03-28 23:12:27,030 - DEBUG - Namespace ctest-non-default-75057733 still in k8s 2025-03-28 23:12:29,035 - DEBUG - Namespace ctest-non-default-75057733 is not in k8s 2025-03-28 23:12:29,035 - DEBUG - No need to check project deletion in contrail-api 2025-03-28 23:12:29,035 - INFO - Deleting namespace ctest-new-default-76643658 2025-03-28 23:12:29,046 - DEBUG - Namespace ctest-new-default-76643658 still in k8s 2025-03-28 23:12:31,051 - DEBUG - Namespace ctest-new-default-76643658 still in k8s 2025-03-28 23:12:33,060 - DEBUG - Namespace ctest-new-default-76643658 still in k8s 2025-03-28 23:12:35,065 - DEBUG - Namespace ctest-new-default-76643658 is not in k8s 2025-03-28 23:12:35,065 - DEBUG - No need to check project deletion in contrail-api