2025-01-27 02:24:01,970 - INFO - Using existing project ['default-domain', 'k8s-default'](5d219225-950c-4e61-b049-f668c957d8dc) 2025-01-27 02:24:01,989 - DEBUG - Namespace ctest-new-default-74187790 not present 2025-01-27 02:24:01,999 - INFO - Created namespace ctest-new-default-74187790 2025-01-27 02:24:05,003 - DEBUG - Namespace ctest-non-default-11788607 not present 2025-01-27 02:24:05,011 - INFO - Created namespace ctest-non-default-11788607 2025-01-27 02:24:08,037 - DEBUG - Pod ctest-pod-03630440 not present 2025-01-27 02:24:08,038 - INFO - Creating Pod ctest-pod-03630440 2025-01-27 02:24:08,058 - DEBUG - Pod : ctest-pod-03630440 UUID is d857e26f-c6fe-483b-bd0e-a76e19324d90 2025-01-27 02:24:08,061 - DEBUG - Pod ctest-pod-87983501 not present 2025-01-27 02:24:08,061 - INFO - Creating Pod ctest-pod-87983501 2025-01-27 02:24:08,106 - DEBUG - Pod : ctest-pod-87983501 UUID is 8d094482-1eab-41a5-93d0-a990cff04790 2025-01-27 02:24:08,108 - DEBUG - Pod ctest-pod-98747214 not present 2025-01-27 02:24:08,108 - INFO - Creating Pod ctest-pod-98747214 2025-01-27 02:24:08,132 - DEBUG - Pod : ctest-pod-98747214 UUID is 22846f48-ee99-4862-b97e-66c129ce0485 2025-01-27 02:24:08,134 - DEBUG - Pod ctest-pod-16005522 not present 2025-01-27 02:24:08,134 - INFO - Creating Pod ctest-pod-16005522 2025-01-27 02:24:08,174 - DEBUG - Pod : ctest-pod-16005522 UUID is 5e3d8194-9e09-4497-937e-e015cbcc72d4 2025-01-27 02:24:08,177 - DEBUG - Pod ctest-pod-49354715 not present 2025-01-27 02:24:08,177 - INFO - Creating Pod ctest-pod-49354715 2025-01-27 02:24:08,199 - DEBUG - Pod : ctest-pod-49354715 UUID is e902516e-eecc-4c8b-b539-ce39a814a099 2025-01-27 02:24:08,201 - DEBUG - Pod ctest-pod-49599918 not present 2025-01-27 02:24:08,201 - INFO - Creating Pod ctest-pod-49599918 2025-01-27 02:24:08,219 - DEBUG - Pod : ctest-pod-49599918 UUID is 007b57f0-225b-4bf4-ac5b-9e3fb78189ea 2025-01-27 02:24:08,221 - DEBUG - Pod ctest-pod-18357730 not present 2025-01-27 02:24:08,221 - INFO - Creating Pod ctest-pod-18357730 2025-01-27 02:24:08,240 - DEBUG - Pod : ctest-pod-18357730 UUID is 136c0e64-9baa-4c88-a809-9944d8d5e330 2025-01-27 02:24:08,243 - DEBUG - Pod ctest-pod-28378749 not present 2025-01-27 02:24:08,243 - INFO - Creating Pod ctest-pod-28378749 2025-01-27 02:24:08,265 - DEBUG - Pod : ctest-pod-28378749 UUID is a0207d19-2128-419e-b5e6-4b991166632a 2025-01-27 02:24:08,457 - INFO - Project default-domain:k8s-ctest-new-default-74187790 for Namespace ctest-new-default-74187790 is seen in contrail-api 2025-01-27 02:24:08,458 - DEBUG - Project uuid in Contrail is 4ce8cfab-6b67-4bec-b089-2951696b65ee 2025-01-27 02:24:08,650 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=114bf57d-63ab-4469-8541-33526bc42430 2025-01-27 02:24:08,655 - INFO - Namespace ctest-new-default-74187790 with uuid 114bf57d-63ab-4469-8541-33526bc42430 found in kube manager 2025-01-27 02:24:08,655 - INFO - Namespace ctest-new-default-74187790 verification passed 2025-01-27 02:24:08,851 - INFO - Project default-domain:k8s-ctest-non-default-11788607 for Namespace ctest-non-default-11788607 is seen in contrail-api 2025-01-27 02:24:08,851 - DEBUG - Project uuid in Contrail is d8e3cfea-d5a0-4f3e-935e-840e00bcf17d 2025-01-27 02:24:08,851 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=dcd15aca-dfd1-475c-bb5d-39a5522f015c 2025-01-27 02:24:08,857 - INFO - Namespace ctest-non-default-11788607 with uuid dcd15aca-dfd1-475c-bb5d-39a5522f015c found in kube manager 2025-01-27 02:24:08,857 - INFO - Namespace ctest-non-default-11788607 verification passed 2025-01-27 02:24:08,863 - DEBUG - Pod ctest-pod-03630440 not in running state.Currently in Pending 2025-01-27 02:24:13,871 - DEBUG - Pod ctest-pod-03630440 not in running state.Currently in Pending 2025-01-27 02:24:18,877 - INFO - Pod ctest-pod-03630440 is in running state.Got IP 10.47.255.251 2025-01-27 02:24:18,948 - DEBUG - Pod ctest-pod-03630440 has vmi ca780742-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:18,948 - INFO - Verified pod ctest-pod-03630440 in contrail-api 2025-01-27 02:24:18,962 - DEBUG - VMI ca780742-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:18,962 - INFO - Verified Pod ctest-pod-03630440 in agent 10.0.0.49 2025-01-27 02:24:18,962 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d857e26f-c6fe-483b-bd0e-a76e19324d90 2025-01-27 02:24:18,967 - INFO - Pod ctest-pod-03630440 with uuid d857e26f-c6fe-483b-bd0e-a76e19324d90 found in kube manager 2025-01-27 02:24:18,967 - INFO - Pod ctest-pod-03630440 verification passed 2025-01-27 02:24:18,973 - INFO - Pod ctest-pod-87983501 is in running state.Got IP 10.47.255.250 2025-01-27 02:24:18,988 - DEBUG - Pod ctest-pod-87983501 has vmi cb08be54-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:18,988 - INFO - Verified pod ctest-pod-87983501 in contrail-api 2025-01-27 02:24:19,004 - DEBUG - VMI cb08be54-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:19,004 - INFO - Verified Pod ctest-pod-87983501 in agent 10.0.0.49 2025-01-27 02:24:19,004 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8d094482-1eab-41a5-93d0-a990cff04790 2025-01-27 02:24:19,010 - INFO - Pod ctest-pod-87983501 with uuid 8d094482-1eab-41a5-93d0-a990cff04790 found in kube manager 2025-01-27 02:24:19,010 - INFO - Pod ctest-pod-87983501 verification passed 2025-01-27 02:24:19,018 - DEBUG - Pod ctest-pod-98747214 not in running state.Currently in Pending 2025-01-27 02:24:24,033 - INFO - Pod ctest-pod-98747214 is in running state.Got IP 10.47.255.249 2025-01-27 02:24:24,096 - DEBUG - Pod ctest-pod-98747214 has vmi cbd17538-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:24,096 - INFO - Verified pod ctest-pod-98747214 in contrail-api 2025-01-27 02:24:24,110 - DEBUG - VMI cbd17538-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:24,110 - INFO - Verified Pod ctest-pod-98747214 in agent 10.0.0.49 2025-01-27 02:24:24,110 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=22846f48-ee99-4862-b97e-66c129ce0485 2025-01-27 02:24:24,116 - INFO - Pod ctest-pod-98747214 with uuid 22846f48-ee99-4862-b97e-66c129ce0485 found in kube manager 2025-01-27 02:24:24,116 - INFO - Pod ctest-pod-98747214 verification passed 2025-01-27 02:24:24,121 - INFO - Pod ctest-pod-16005522 is in running state.Got IP 10.47.255.248 2025-01-27 02:24:24,136 - DEBUG - Pod ctest-pod-16005522 has vmi cc618b14-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:24,136 - INFO - Verified pod ctest-pod-16005522 in contrail-api 2025-01-27 02:24:24,151 - DEBUG - VMI cc618b14-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:24,151 - INFO - Verified Pod ctest-pod-16005522 in agent 10.0.0.49 2025-01-27 02:24:24,152 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=5e3d8194-9e09-4497-937e-e015cbcc72d4 2025-01-27 02:24:24,157 - INFO - Pod ctest-pod-16005522 with uuid 5e3d8194-9e09-4497-937e-e015cbcc72d4 found in kube manager 2025-01-27 02:24:24,157 - INFO - Pod ctest-pod-16005522 verification passed 2025-01-27 02:24:24,163 - DEBUG - Pod ctest-pod-49354715 not in running state.Currently in Pending 2025-01-27 02:24:29,174 - INFO - Pod ctest-pod-49354715 is in running state.Got IP 10.47.255.247 2025-01-27 02:24:29,232 - DEBUG - Pod ctest-pod-49354715 has vmi ccfc7372-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:29,232 - INFO - Verified pod ctest-pod-49354715 in contrail-api 2025-01-27 02:24:29,248 - DEBUG - VMI ccfc7372-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:29,248 - INFO - Verified Pod ctest-pod-49354715 in agent 10.0.0.49 2025-01-27 02:24:29,248 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=e902516e-eecc-4c8b-b539-ce39a814a099 2025-01-27 02:24:29,259 - INFO - Pod ctest-pod-49354715 with uuid e902516e-eecc-4c8b-b539-ce39a814a099 found in kube manager 2025-01-27 02:24:29,259 - INFO - Pod ctest-pod-49354715 verification passed 2025-01-27 02:24:29,342 - INFO - Pod ctest-pod-18357730 is in running state.Got IP 10.47.255.245 2025-01-27 02:24:29,358 - DEBUG - Pod ctest-pod-18357730 has vmi cdfda598-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:29,358 - INFO - Verified pod ctest-pod-18357730 in contrail-api 2025-01-27 02:24:29,376 - DEBUG - VMI cdfda598-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:29,376 - INFO - Verified Pod ctest-pod-18357730 in agent 10.0.0.49 2025-01-27 02:24:29,376 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=136c0e64-9baa-4c88-a809-9944d8d5e330 2025-01-27 02:24:29,381 - INFO - Pod ctest-pod-18357730 with uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 found in kube manager 2025-01-27 02:24:29,381 - INFO - Pod ctest-pod-18357730 verification passed 2025-01-27 02:24:29,387 - INFO - Pod ctest-pod-49599918 is in running state.Got IP 10.47.255.246 2025-01-27 02:24:29,452 - DEBUG - Pod ctest-pod-49599918 has vmi cd79d902-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:29,452 - INFO - Verified pod ctest-pod-49599918 in contrail-api 2025-01-27 02:24:29,469 - DEBUG - VMI cd79d902-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:29,469 - INFO - Verified Pod ctest-pod-49599918 in agent 10.0.0.49 2025-01-27 02:24:29,469 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=007b57f0-225b-4bf4-ac5b-9e3fb78189ea 2025-01-27 02:24:29,474 - INFO - Pod ctest-pod-49599918 with uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea found in kube manager 2025-01-27 02:24:29,474 - INFO - Pod ctest-pod-49599918 verification passed 2025-01-27 02:24:29,479 - INFO - Pod ctest-pod-28378749 is in running state.Got IP 10.47.255.244 2025-01-27 02:24:29,498 - DEBUG - Pod ctest-pod-28378749 has vmi ce7d5d92-dc55-11ef-b21f-fa163e196065 2025-01-27 02:24:29,498 - INFO - Verified pod ctest-pod-28378749 in contrail-api 2025-01-27 02:24:29,511 - DEBUG - VMI ce7d5d92-dc55-11ef-b21f-fa163e196065 is active in agent 10.0.0.49 2025-01-27 02:24:29,511 - INFO - Verified Pod ctest-pod-28378749 in agent 10.0.0.49 2025-01-27 02:24:29,511 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=a0207d19-2128-419e-b5e6-4b991166632a 2025-01-27 02:24:29,516 - INFO - Pod ctest-pod-28378749 with uuid a0207d19-2128-419e-b5e6-4b991166632a found in kube manager 2025-01-27 02:24:29,516 - INFO - Pod ctest-pod-28378749 verification passed 2025-01-27 02:24:29,516 - INFO - ================================================================================ 2025-01-27 02:24:29,517 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-27 02:24:29,517 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-27 02:24:29,751 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.27': '0'}} with 2025-01-27 02:24:29,751 - INFO - Initial checks done. Running the testcase now 2025-01-27 02:24:29,751 - INFO - 2025-01-27 02:24:29,801 - DEBUG - [Pod ctest-pod-03630440] Cmd: echo ctest-pod-03630440 > /usr/share/nginx/html/index.html, Output: 2025-01-27 02:24:29,880 - DEBUG - [Pod ctest-pod-87983501] Cmd: echo ctest-pod-87983501 > /usr/share/nginx/html/index.html, Output: 2025-01-27 02:24:29,971 - DEBUG - [Pod ctest-pod-98747214] Cmd: echo ctest-pod-98747214 > /usr/share/nginx/html/index.html, Output: 2025-01-27 02:24:30,043 - DEBUG - [Pod ctest-pod-16005522] Cmd: echo ctest-pod-16005522 > /usr/share/nginx/html/index.html, Output: 2025-01-27 02:24:30,047 - DEBUG - Service ctest-nginx-svc-85459714 not present 2025-01-27 02:24:30,047 - INFO - Creating service ctest-nginx-svc-85459714 2025-01-27 02:24:30,060 - INFO - Created Service ctest-nginx-svc-85459714 2025-01-27 02:24:30,072 - WARNING - Service UUID 64e721aa-e334-46a8-a06d-ae484ef26c35 not yet found in contrail-api 2025-01-27 02:24:31,081 - INFO - Validated that Service ctest-nginx-svc-85459714 is seen in contrail-api 2025-01-27 02:24:31,081 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=64e721aa-e334-46a8-a06d-ae484ef26c35 2025-01-27 02:24:31,086 - INFO - Service ctest-nginx-svc-85459714 with uuid 64e721aa-e334-46a8-a06d-ae484ef26c35 found in kube manager 2025-01-27 02:24:31,086 - INFO - Service ctest-nginx-svc-85459714 verification passed 2025-01-27 02:24:32,165 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87983501 2025-01-27 02:24:32,165 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:24:32,165 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87983501 2025-01-27 02:24:32,229 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) ctest-pod-03630440 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:24:32,229 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:24:32,229 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) ctest-pod-03630440 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:24:32,229 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03630440': 1, 'ctest-pod-87983501': 1} 2025-01-27 02:24:32,295 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03630440 2025-01-27 02:24:32,295 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:24:32,296 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03630440 2025-01-27 02:24:32,384 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:24:32,384 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:24:32,384 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:24:32,384 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03630440': 1, 'ctest-pod-87983501': 1} 2025-01-27 02:24:32,388 - DEBUG - Network policy ingress-on-service not present 2025-01-27 02:24:32,388 - INFO - Creating Network Policy ingress-on-service 2025-01-27 02:24:32,426 - INFO - Network policy found in k8s 2025-01-27 02:24:32,426 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=34d787e2-4b80-45c5-8bca-11bf44b9d819 2025-01-27 02:24:32,452 - INFO - Network Policy ingress-on-service with uuid 34d787e2-4b80-45c5-8bca-11bf44b9d819 found in kube manager 2025-01-27 02:24:32,487 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-27 02:24:32,487 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-27 02:24:32,488 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=34d787e2-4b80-45c5-8bca-11bf44b9d819 2025-01-27 02:24:32,517 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-27 02:24:34,518 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=34d787e2-4b80-45c5-8bca-11bf44b9d819 2025-01-27 02:24:34,550 - INFO - Network policy with name ingress-on-service found in agent 2025-01-27 02:24:34,551 - INFO - Network Policy ingress-on-service verification passed 2025-01-27 02:24:39,605 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:39,605 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:39,605 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:44,673 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:44,673 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:44,673 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:49,742 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:49,742 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:49,742 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:54,803 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:54,804 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:54,804 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:59,858 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:59,858 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:24:59,858 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:04,908 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:04,908 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:04,908 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:09,953 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:09,953 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:09,954 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:15,023 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:15,023 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:15,023 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:20,084 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:20,084 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:20,084 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:25,139 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:25,139 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:25,139 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:25,139 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03630440': 0, 'ctest-pod-87983501': 0} 2025-01-27 02:25:25,209 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,209 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:25:25,209 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,264 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,264 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:25:25,264 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,332 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,333 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:25:25,333 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:25:25,333 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03630440': 2, 'ctest-pod-87983501': 1} 2025-01-27 02:25:30,386 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:30,386 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:30,386 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:35,446 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:35,446 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:35,446 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:40,509 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:40,510 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:40,510 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:45,576 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:45,576 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:45,576 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:50,627 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:50,627 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:50,627 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:55,685 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:55,685 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:25:55,685 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:00,758 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:00,758 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:00,758 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:05,821 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:05,821 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:05,821 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:10,875 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:10,875 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:10,875 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:13,669 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-27 02:26:23,746 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:23,746 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:23,746 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:23,746 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03630440': 0, 'ctest-pod-87983501': 0} 2025-01-27 02:26:25,795 - DEBUG - [Pod ctest-pod-49599918] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.362 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.170/0.362 ms 2025-01-27 02:26:25,795 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49599918 with expectation True passed 2025-01-27 02:26:27,860 - DEBUG - [Pod ctest-pod-49354715] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.623 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.258/0.623 ms 2025-01-27 02:26:27,860 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49354715 with expectation True passed 2025-01-27 02:26:29,922 - DEBUG - [Pod ctest-pod-18357730] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.218 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.466/1.218 ms 2025-01-27 02:26:29,922 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18357730 with expectation True passed 2025-01-27 02:26:29,992 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:26:29,992 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-27 02:26:29,992 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:26:29,992 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49599918 passed 2025-01-27 02:26:30,049 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:26:30,049 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-27 02:26:30,049 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:26:30,049 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49599918 passed 2025-01-27 02:26:35,114 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:26:35,115 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:26:35,115 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:26:35,115 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49354715 passed 2025-01-27 02:26:40,165 - DEBUG - [Pod ctest-pod-28378749] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-27 02:26:40,165 - DEBUG - [Pod Pod ctest-pod-28378749] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-27 02:26:40,165 - DEBUG - [Pod Pod ctest-pod-28378749] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-27 02:26:40,165 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28378749 passed 2025-01-27 02:26:40,174 - INFO - Updating Network Policy ingress-on-service 2025-01-27 02:26:45,253 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:45,253 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:45,253 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:50,329 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:50,329 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:50,329 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:55,390 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:55,390 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:26:55,390 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:00,457 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:00,457 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:00,457 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:05,520 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:05,520 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:05,520 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:10,591 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:10,591 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:10,591 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:15,654 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:15,654 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:15,654 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:20,706 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:20,706 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:20,706 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:25,767 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:25,767 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:25,767 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:30,836 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:30,836 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:30,836 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) wget: download timed out 2025-01-27 02:27:30,837 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03630440': 0, 'ctest-pod-87983501': 0} 2025-01-27 02:27:30,913 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:30,913 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:30,913 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:30,976 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:30,976 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:30,976 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:30,976 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03630440': 1, 'ctest-pod-87983501': 1} 2025-01-27 02:27:31,042 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03630440 2025-01-27 02:27:31,042 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:31,042 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03630440 2025-01-27 02:27:31,103 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,104 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:31,104 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,156 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,156 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:31,156 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,215 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,215 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:31,215 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: ctest-pod-03630440 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,252 - DEBUG - [Pod ctest-pod-18357730] Cmd: wget http://10.110.170.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,253 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd wget http://10.110.170.99:80/ -O - -T 5 -t 1 passed 2025-01-27 02:27:31,253 - DEBUG - [Pod Pod ctest-pod-18357730] Cmd output: ctest-pod-87983501 Connecting to 10.110.170.99:80 (10.110.170.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-27 02:27:31,253 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03630440': 4, 'ctest-pod-87983501': 1} 2025-01-27 02:27:33,303 - DEBUG - [Pod ctest-pod-49599918] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.972 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.379/0.972 ms 2025-01-27 02:27:33,303 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49599918 with expectation True passed 2025-01-27 02:27:35,367 - DEBUG - [Pod ctest-pod-49354715] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.828 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.658/1.828 ms 2025-01-27 02:27:35,367 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49354715 with expectation True passed 2025-01-27 02:27:37,430 - DEBUG - [Pod ctest-pod-18357730] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.988 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.378/0.988 ms 2025-01-27 02:27:37,431 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18357730 with expectation True passed 2025-01-27 02:27:37,491 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:37,491 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-27 02:27:37,491 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:37,491 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49599918 passed 2025-01-27 02:27:37,553 - DEBUG - [Pod ctest-pod-49599918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:37,553 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-27 02:27:37,553 - DEBUG - [Pod Pod ctest-pod-49599918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:37,553 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49599918 passed 2025-01-27 02:27:42,621 - DEBUG - [Pod ctest-pod-49354715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:27:42,622 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:27:42,622 - DEBUG - [Pod Pod ctest-pod-49354715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-27 02:27:42,622 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49354715 passed 2025-01-27 02:27:42,683 - DEBUG - [Pod ctest-pod-28378749] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:42,683 - DEBUG - [Pod Pod ctest-pod-28378749] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-27 02:27:42,683 - DEBUG - [Pod Pod ctest-pod-28378749] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-27 02:27:42,683 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28378749 passed 2025-01-27 02:27:42,684 - INFO - Deleting Network Policy : ingress-on-service 2025-01-27 02:27:42,684 - INFO - Deleting service : ctest-nginx-svc-85459714 2025-01-27 02:27:42,917 - DEBUG - No XMPP flaps were noticed during the test 2025-01-27 02:27:42,918 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13] 2025-01-27 02:27:42,918 - INFO - -------------------------------------------------------------------------------- 2025-01-27 02:27:42,923 - INFO - Deleting pod ctest-new-default-74187790:ctest-pod-03630440 2025-01-27 02:27:42,924 - INFO - Deleting pod ctest-new-default-74187790:ctest-pod-87983501 2025-01-27 02:27:42,924 - INFO - Deleting pod ctest-non-default-11788607:ctest-pod-98747214 2025-01-27 02:27:42,925 - INFO - Deleting pod ctest-non-default-11788607:ctest-pod-16005522 2025-01-27 02:27:42,925 - INFO - Deleting pod ctest-new-default-74187790:ctest-pod-49354715 2025-01-27 02:27:42,925 - INFO - Deleting pod ctest-new-default-74187790:ctest-pod-49599918 2025-01-27 02:27:42,926 - INFO - Deleting pod ctest-non-default-11788607:ctest-pod-18357730 2025-01-27 02:27:42,926 - INFO - Deleting pod ctest-non-default-11788607:ctest-pod-28378749 2025-01-27 02:27:43,015 - WARNING - Pod uuid d857e26f-c6fe-483b-bd0e-a76e19324d90 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,098 - WARNING - Pod uuid 8d094482-1eab-41a5-93d0-a990cff04790 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,099 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,099 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,100 - WARNING - Pod uuid 22846f48-ee99-4862-b97e-66c129ce0485 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,101 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,101 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:43,101 - WARNING - Pod uuid 5e3d8194-9e09-4497-937e-e015cbcc72d4 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:48,024 - DEBUG - Pod d857e26f-c6fe-483b-bd0e-a76e19324d90 is not in agent 10.0.0.49 VM list 2025-01-27 02:27:48,031 - DEBUG - VMI ca780742-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:27:48,031 - INFO - Verified that pod ctest-pod-03630440 is removed in agent 2025-01-27 02:27:48,131 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:48,132 - DEBUG - Pod 22846f48-ee99-4862-b97e-66c129ce0485 is not in agent 10.0.0.49 VM list 2025-01-27 02:27:48,134 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:48,134 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:48,135 - DEBUG - Pod 8d094482-1eab-41a5-93d0-a990cff04790 is not in agent 10.0.0.49 VM list 2025-01-27 02:27:48,139 - DEBUG - Pod 5e3d8194-9e09-4497-937e-e015cbcc72d4 is not in agent 10.0.0.49 VM list 2025-01-27 02:27:48,141 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:48,152 - DEBUG - VMI cbd17538-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:27:48,153 - INFO - Verified that pod ctest-pod-98747214 is removed in agent 2025-01-27 02:27:48,154 - DEBUG - VMI cc618b14-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:27:48,155 - INFO - Verified that pod ctest-pod-16005522 is removed in agent 2025-01-27 02:27:48,155 - DEBUG - VMI cb08be54-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:27:48,155 - INFO - Verified that pod ctest-pod-87983501 is removed in agent 2025-01-27 02:27:53,151 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:53,154 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:53,156 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:53,156 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:58,161 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:58,171 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:58,173 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:27:58,173 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:03,170 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:03,186 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:03,188 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:03,189 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:08,178 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:08,202 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:08,204 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:08,205 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:13,227 - WARNING - Pod uuid e902516e-eecc-4c8b-b539-ce39a814a099 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:13,228 - WARNING - Pod uuid a0207d19-2128-419e-b5e6-4b991166632a is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:13,229 - WARNING - Pod uuid 136c0e64-9baa-4c88-a809-9944d8d5e330 is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:13,229 - WARNING - Pod uuid 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is still seen in agent 10.0.0.49 VM list 2025-01-27 02:28:18,246 - DEBUG - Pod e902516e-eecc-4c8b-b539-ce39a814a099 is not in agent 10.0.0.49 VM list 2025-01-27 02:28:18,249 - DEBUG - Pod 136c0e64-9baa-4c88-a809-9944d8d5e330 is not in agent 10.0.0.49 VM list 2025-01-27 02:28:18,251 - DEBUG - Pod a0207d19-2128-419e-b5e6-4b991166632a is not in agent 10.0.0.49 VM list 2025-01-27 02:28:18,252 - DEBUG - Pod 007b57f0-225b-4bf4-ac5b-9e3fb78189ea is not in agent 10.0.0.49 VM list 2025-01-27 02:28:18,264 - DEBUG - VMI cdfda598-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:28:18,264 - INFO - Verified that pod ctest-pod-18357730 is removed in agent 2025-01-27 02:28:18,266 - DEBUG - VMI ce7d5d92-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:28:18,266 - INFO - Verified that pod ctest-pod-28378749 is removed in agent 2025-01-27 02:28:18,266 - DEBUG - VMI ccfc7372-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:28:18,267 - INFO - Verified that pod ctest-pod-49354715 is removed in agent 2025-01-27 02:28:18,267 - DEBUG - VMI cd79d902-dc55-11ef-b21f-fa163e196065 is removed from agent 10.0.0.49 2025-01-27 02:28:18,267 - INFO - Verified that pod ctest-pod-49599918 is removed in agent 2025-01-27 02:28:18,267 - INFO - Deleting namespace ctest-non-default-11788607 2025-01-27 02:28:18,283 - DEBUG - Namespace ctest-non-default-11788607 still in k8s 2025-01-27 02:28:20,289 - DEBUG - Namespace ctest-non-default-11788607 still in k8s 2025-01-27 02:28:22,294 - DEBUG - Namespace ctest-non-default-11788607 still in k8s 2025-01-27 02:28:24,300 - DEBUG - Namespace ctest-non-default-11788607 is not in k8s 2025-01-27 02:28:24,300 - DEBUG - No need to check project deletion in contrail-api 2025-01-27 02:28:24,300 - INFO - Deleting namespace ctest-new-default-74187790 2025-01-27 02:28:24,308 - DEBUG - Namespace ctest-new-default-74187790 still in k8s 2025-01-27 02:28:26,313 - DEBUG - Namespace ctest-new-default-74187790 still in k8s 2025-01-27 02:28:28,325 - DEBUG - Namespace ctest-new-default-74187790 still in k8s 2025-01-27 02:28:30,329 - DEBUG - Namespace ctest-new-default-74187790 is not in k8s 2025-01-27 02:28:30,329 - DEBUG - No need to check project deletion in contrail-api