2025-10-31 03:05:07,730 - INFO - Using existing project ['default-domain', 'k8s-default'](0766af53-cd84-48d6-90ae-103405a8604a) 2025-10-31 03:05:07,753 - DEBUG - Namespace ctest-new-default-22455336 not present 2025-10-31 03:05:07,761 - INFO - Created namespace ctest-new-default-22455336 2025-10-31 03:05:10,765 - DEBUG - Namespace ctest-non-default-17824071 not present 2025-10-31 03:05:10,774 - INFO - Created namespace ctest-non-default-17824071 2025-10-31 03:05:13,794 - DEBUG - Pod ctest-pod-81757709 not present 2025-10-31 03:05:13,795 - INFO - Creating Pod ctest-pod-81757709 2025-10-31 03:05:13,842 - DEBUG - Pod : ctest-pod-81757709 UUID is 57301788-41ce-4184-947b-d1df9d01a5a7 2025-10-31 03:05:13,849 - DEBUG - Pod ctest-pod-21733849 not present 2025-10-31 03:05:13,849 - INFO - Creating Pod ctest-pod-21733849 2025-10-31 03:05:13,885 - DEBUG - Pod : ctest-pod-21733849 UUID is f5132cf4-4a3d-4260-9982-7f3e851a1558 2025-10-31 03:05:13,889 - DEBUG - Pod ctest-pod-21574294 not present 2025-10-31 03:05:13,889 - INFO - Creating Pod ctest-pod-21574294 2025-10-31 03:05:13,916 - DEBUG - Pod : ctest-pod-21574294 UUID is 343ffa84-9c8e-4175-af50-e6804618eec8 2025-10-31 03:05:13,919 - DEBUG - Pod ctest-pod-17054267 not present 2025-10-31 03:05:13,920 - INFO - Creating Pod ctest-pod-17054267 2025-10-31 03:05:13,955 - DEBUG - Pod : ctest-pod-17054267 UUID is 198075a1-eef7-445b-87f6-bfc51d96e3e4 2025-10-31 03:05:13,958 - DEBUG - Pod ctest-pod-29449313 not present 2025-10-31 03:05:13,959 - INFO - Creating Pod ctest-pod-29449313 2025-10-31 03:05:13,983 - DEBUG - Pod : ctest-pod-29449313 UUID is 142c3445-3618-4b32-a8b8-f0cb76c8df99 2025-10-31 03:05:13,986 - DEBUG - Pod ctest-pod-38934700 not present 2025-10-31 03:05:13,986 - INFO - Creating Pod ctest-pod-38934700 2025-10-31 03:05:14,030 - DEBUG - Pod : ctest-pod-38934700 UUID is e6340b53-46c1-4dfb-9f8c-0147bacee3f3 2025-10-31 03:05:14,035 - DEBUG - Pod ctest-pod-48040407 not present 2025-10-31 03:05:14,036 - INFO - Creating Pod ctest-pod-48040407 2025-10-31 03:05:14,072 - DEBUG - Pod : ctest-pod-48040407 UUID is 5659881d-8292-4113-8c97-75e72aff3643 2025-10-31 03:05:14,075 - DEBUG - Pod ctest-pod-41120826 not present 2025-10-31 03:05:14,075 - INFO - Creating Pod ctest-pod-41120826 2025-10-31 03:05:14,101 - DEBUG - Pod : ctest-pod-41120826 UUID is 49e04ee0-afc6-4889-96a8-02128d83ad7c 2025-10-31 03:05:14,366 - INFO - Project default-domain:k8s-ctest-new-default-22455336 for Namespace ctest-new-default-22455336 is seen in contrail-api 2025-10-31 03:05:14,366 - DEBUG - Project uuid in Contrail is 25547006-1ea2-429d-9009-1c2f3c5e95b3 2025-10-31 03:05:14,513 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=3876b8c6-9aa6-45a2-bfac-890b72b4d13c 2025-10-31 03:05:14,518 - INFO - Namespace ctest-new-default-22455336 with uuid 3876b8c6-9aa6-45a2-bfac-890b72b4d13c found in kube manager 2025-10-31 03:05:14,518 - INFO - Namespace ctest-new-default-22455336 verification passed 2025-10-31 03:05:14,765 - INFO - Project default-domain:k8s-ctest-non-default-17824071 for Namespace ctest-non-default-17824071 is seen in contrail-api 2025-10-31 03:05:14,765 - DEBUG - Project uuid in Contrail is 3532e54e-52b9-4735-8f2f-8663f2d0eff6 2025-10-31 03:05:14,766 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=6acae83a-63c6-4eb4-b1fe-1e265a1d6c57 2025-10-31 03:05:14,769 - INFO - Namespace ctest-non-default-17824071 with uuid 6acae83a-63c6-4eb4-b1fe-1e265a1d6c57 found in kube manager 2025-10-31 03:05:14,770 - INFO - Namespace ctest-non-default-17824071 verification passed 2025-10-31 03:05:14,777 - DEBUG - Pod ctest-pod-81757709 not in running state.Currently in Pending 2025-10-31 03:05:19,796 - DEBUG - Pod ctest-pod-81757709 not in running state.Currently in Pending 2025-10-31 03:05:24,805 - DEBUG - Pod ctest-pod-81757709 not in running state.Currently in Pending 2025-10-31 03:05:29,813 - INFO - Pod ctest-pod-81757709 is in running state.Got IP 10.47.255.251 2025-10-31 03:05:29,825 - DEBUG - Pod ctest-pod-81757709 has vmi 6c9059c8-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:29,825 - INFO - Verified pod ctest-pod-81757709 in contrail-api 2025-10-31 03:05:29,840 - DEBUG - VMI 6c9059c8-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:29,840 - INFO - Verified Pod ctest-pod-81757709 in agent 10.0.0.23 2025-10-31 03:05:29,840 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=57301788-41ce-4184-947b-d1df9d01a5a7 2025-10-31 03:05:29,845 - INFO - Pod ctest-pod-81757709 with uuid 57301788-41ce-4184-947b-d1df9d01a5a7 found in kube manager 2025-10-31 03:05:29,845 - INFO - Pod ctest-pod-81757709 verification passed 2025-10-31 03:05:29,852 - INFO - Pod ctest-pod-21733849 is in running state.Got IP 10.47.255.250 2025-10-31 03:05:29,910 - DEBUG - Pod ctest-pod-21733849 has vmi 6d0bfd3a-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:29,910 - INFO - Verified pod ctest-pod-21733849 in contrail-api 2025-10-31 03:05:29,923 - DEBUG - VMI 6d0bfd3a-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:29,923 - INFO - Verified Pod ctest-pod-21733849 in agent 10.0.0.23 2025-10-31 03:05:29,923 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=f5132cf4-4a3d-4260-9982-7f3e851a1558 2025-10-31 03:05:29,927 - INFO - Pod ctest-pod-21733849 with uuid f5132cf4-4a3d-4260-9982-7f3e851a1558 found in kube manager 2025-10-31 03:05:29,927 - INFO - Pod ctest-pod-21733849 verification passed 2025-10-31 03:05:29,943 - INFO - Pod ctest-pod-21574294 is in running state.Got IP 10.47.255.249 2025-10-31 03:05:29,998 - DEBUG - Pod ctest-pod-21574294 has vmi 6dad4d2a-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:29,998 - INFO - Verified pod ctest-pod-21574294 in contrail-api 2025-10-31 03:05:30,010 - DEBUG - VMI 6dad4d2a-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:30,011 - INFO - Verified Pod ctest-pod-21574294 in agent 10.0.0.23 2025-10-31 03:05:30,011 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=343ffa84-9c8e-4175-af50-e6804618eec8 2025-10-31 03:05:30,015 - INFO - Pod ctest-pod-21574294 with uuid 343ffa84-9c8e-4175-af50-e6804618eec8 found in kube manager 2025-10-31 03:05:30,015 - INFO - Pod ctest-pod-21574294 verification passed 2025-10-31 03:05:30,024 - INFO - Pod ctest-pod-17054267 is in running state.Got IP 10.47.255.248 2025-10-31 03:05:30,039 - DEBUG - Pod ctest-pod-17054267 has vmi 6e265e5e-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:30,039 - INFO - Verified pod ctest-pod-17054267 in contrail-api 2025-10-31 03:05:30,049 - DEBUG - VMI 6e265e5e-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:30,050 - INFO - Verified Pod ctest-pod-17054267 in agent 10.0.0.23 2025-10-31 03:05:30,050 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=198075a1-eef7-445b-87f6-bfc51d96e3e4 2025-10-31 03:05:30,054 - INFO - Pod ctest-pod-17054267 with uuid 198075a1-eef7-445b-87f6-bfc51d96e3e4 found in kube manager 2025-10-31 03:05:30,055 - INFO - Pod ctest-pod-17054267 verification passed 2025-10-31 03:05:30,069 - DEBUG - Pod ctest-pod-29449313 not in running state.Currently in Pending 2025-10-31 03:05:35,079 - INFO - Pod ctest-pod-29449313 is in running state.Got IP 10.47.255.247 2025-10-31 03:05:35,134 - DEBUG - Pod ctest-pod-29449313 has vmi 6eb2fb16-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:35,134 - INFO - Verified pod ctest-pod-29449313 in contrail-api 2025-10-31 03:05:35,146 - DEBUG - VMI 6eb2fb16-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:35,147 - INFO - Verified Pod ctest-pod-29449313 in agent 10.0.0.23 2025-10-31 03:05:35,147 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=142c3445-3618-4b32-a8b8-f0cb76c8df99 2025-10-31 03:05:35,151 - INFO - Pod ctest-pod-29449313 with uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 found in kube manager 2025-10-31 03:05:35,151 - INFO - Pod ctest-pod-29449313 verification passed 2025-10-31 03:05:35,159 - INFO - Pod ctest-pod-48040407 is in running state.Got IP 10.47.255.245 2025-10-31 03:05:35,172 - DEBUG - Pod ctest-pod-48040407 has vmi 6f9c68b4-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:35,172 - INFO - Verified pod ctest-pod-48040407 in contrail-api 2025-10-31 03:05:35,187 - DEBUG - VMI 6f9c68b4-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:35,187 - INFO - Verified Pod ctest-pod-48040407 in agent 10.0.0.23 2025-10-31 03:05:35,187 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=5659881d-8292-4113-8c97-75e72aff3643 2025-10-31 03:05:35,192 - INFO - Pod ctest-pod-48040407 with uuid 5659881d-8292-4113-8c97-75e72aff3643 found in kube manager 2025-10-31 03:05:35,192 - INFO - Pod ctest-pod-48040407 verification passed 2025-10-31 03:05:35,200 - INFO - Pod ctest-pod-38934700 is in running state.Got IP 10.47.255.246 2025-10-31 03:05:35,254 - DEBUG - Pod ctest-pod-38934700 has vmi 6f266254-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:35,254 - INFO - Verified pod ctest-pod-38934700 in contrail-api 2025-10-31 03:05:35,265 - DEBUG - VMI 6f266254-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:35,265 - INFO - Verified Pod ctest-pod-38934700 in agent 10.0.0.23 2025-10-31 03:05:35,265 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=e6340b53-46c1-4dfb-9f8c-0147bacee3f3 2025-10-31 03:05:35,270 - INFO - Pod ctest-pod-38934700 with uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 found in kube manager 2025-10-31 03:05:35,270 - INFO - Pod ctest-pod-38934700 verification passed 2025-10-31 03:05:35,278 - INFO - Pod ctest-pod-41120826 is in running state.Got IP 10.47.255.244 2025-10-31 03:05:35,334 - DEBUG - Pod ctest-pod-41120826 has vmi 7010301e-b606-11f0-bb1a-fa163e479cb1 2025-10-31 03:05:35,334 - INFO - Verified pod ctest-pod-41120826 in contrail-api 2025-10-31 03:05:35,349 - DEBUG - VMI 7010301e-b606-11f0-bb1a-fa163e479cb1 is active in agent 10.0.0.23 2025-10-31 03:05:35,349 - INFO - Verified Pod ctest-pod-41120826 in agent 10.0.0.23 2025-10-31 03:05:35,349 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=49e04ee0-afc6-4889-96a8-02128d83ad7c 2025-10-31 03:05:35,358 - INFO - Pod ctest-pod-41120826 with uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c found in kube manager 2025-10-31 03:05:35,359 - INFO - Pod ctest-pod-41120826 verification passed 2025-10-31 03:05:35,359 - INFO - ================================================================================ 2025-10-31 03:05:35,359 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-31 03:05:35,359 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-31 03:05:35,617 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.73': '0'}} with 2025-10-31 03:05:35,617 - INFO - Initial checks done. Running the testcase now 2025-10-31 03:05:35,617 - INFO - 2025-10-31 03:05:35,685 - DEBUG - [Pod ctest-pod-81757709] Cmd: echo ctest-pod-81757709 > /usr/share/nginx/html/index.html, Output: 2025-10-31 03:05:35,740 - DEBUG - [Pod ctest-pod-21733849] Cmd: echo ctest-pod-21733849 > /usr/share/nginx/html/index.html, Output: 2025-10-31 03:05:35,803 - DEBUG - [Pod ctest-pod-21574294] Cmd: echo ctest-pod-21574294 > /usr/share/nginx/html/index.html, Output: 2025-10-31 03:05:35,866 - DEBUG - [Pod ctest-pod-17054267] Cmd: echo ctest-pod-17054267 > /usr/share/nginx/html/index.html, Output: 2025-10-31 03:05:35,869 - DEBUG - Service ctest-nginx-svc-36510157 not present 2025-10-31 03:05:35,870 - INFO - Creating service ctest-nginx-svc-36510157 2025-10-31 03:05:35,889 - INFO - Created Service ctest-nginx-svc-36510157 2025-10-31 03:05:35,906 - WARNING - Service UUID 448457df-e7ef-402a-bc48-146d50c07739 not yet found in contrail-api 2025-10-31 03:05:36,930 - INFO - Validated that Service ctest-nginx-svc-36510157 is seen in contrail-api 2025-10-31 03:05:36,930 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_LoadbalancerDatabaseList?x=448457df-e7ef-402a-bc48-146d50c07739 2025-10-31 03:05:36,934 - INFO - Service ctest-nginx-svc-36510157 with uuid 448457df-e7ef-402a-bc48-146d50c07739 found in kube manager 2025-10-31 03:05:36,935 - INFO - Service ctest-nginx-svc-36510157 verification passed 2025-10-31 03:05:38,011 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81757709 2025-10-31 03:05:38,011 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,011 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81757709 2025-10-31 03:05:38,068 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,068 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,068 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,068 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81757709': 1, 'ctest-pod-21733849': 1} 2025-10-31 03:05:38,130 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,130 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,130 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,188 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,188 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,188 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,246 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,246 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,246 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:05:38,299 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21733849 2025-10-31 03:05:38,299 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:05:38,299 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21733849 2025-10-31 03:05:38,299 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81757709': 3, 'ctest-pod-21733849': 1} 2025-10-31 03:05:38,303 - DEBUG - Network policy ingress-on-service not present 2025-10-31 03:05:38,303 - INFO - Creating Network Policy ingress-on-service 2025-10-31 03:05:38,320 - INFO - Network policy found in k8s 2025-10-31 03:05:38,320 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b990e8df-abd7-433a-bcbf-139e08a2bb89 2025-10-31 03:05:38,326 - INFO - Network Policy ingress-on-service with uuid b990e8df-abd7-433a-bcbf-139e08a2bb89 found in kube manager 2025-10-31 03:05:38,354 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-31 03:05:38,355 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-31 03:05:38,355 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b990e8df-abd7-433a-bcbf-139e08a2bb89 2025-10-31 03:05:38,386 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-31 03:05:40,387 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b990e8df-abd7-433a-bcbf-139e08a2bb89 2025-10-31 03:05:40,415 - INFO - Network policy with name ingress-on-service found in agent 2025-10-31 03:05:40,415 - INFO - Network Policy ingress-on-service verification passed 2025-10-31 03:05:45,472 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:45,472 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:45,472 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:50,524 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:50,524 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:50,524 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:55,587 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:55,588 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:05:55,588 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:00,647 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:00,647 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:00,647 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:05,702 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:05,703 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:05,703 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:10,762 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:10,763 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:10,763 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:15,814 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:15,814 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:15,814 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:20,866 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:20,866 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:20,866 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:25,934 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:25,934 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:25,934 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:30,986 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:30,986 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:30,987 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:30,987 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81757709': 0, 'ctest-pod-21733849': 0} 2025-10-31 03:06:31,052 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,052 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,052 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,108 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,108 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,108 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,168 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,168 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,168 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,229 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,229 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,229 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,289 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81757709 2025-10-31 03:06:31,289 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,289 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81757709 2025-10-31 03:06:31,344 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,344 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:06:31,344 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:06:31,344 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81757709': 5, 'ctest-pod-21733849': 1} 2025-10-31 03:06:36,403 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:36,403 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:36,403 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:41,451 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:41,451 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:41,451 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:46,514 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:46,514 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:46,514 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:51,566 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:51,566 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:51,566 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:56,619 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:56,619 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:06:56,619 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:01,672 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:01,672 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:01,672 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:06,731 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:06,731 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:06,731 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:11,786 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:11,786 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:11,786 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:16,715 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-10-31 03:07:26,790 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:26,791 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:26,791 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:31,842 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:31,843 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:31,843 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:31,843 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81757709': 0, 'ctest-pod-21733849': 0} 2025-10-31 03:07:33,920 - DEBUG - [Pod ctest-pod-38934700] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.781 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.322/0.781 ms 2025-10-31 03:07:33,920 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-38934700 with expectation True passed 2025-10-31 03:07:35,979 - DEBUG - [Pod ctest-pod-29449313] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.602 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.261/0.602 ms 2025-10-31 03:07:35,979 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29449313 with expectation True passed 2025-10-31 03:07:38,035 - DEBUG - [Pod ctest-pod-48040407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.470 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.547/1.470 ms 2025-10-31 03:07:38,035 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48040407 with expectation True passed 2025-10-31 03:07:38,096 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:07:38,096 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 03:07:38,096 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:07:38,096 - INFO - wget check of of http://10.47.255.251 from ctest-pod-38934700 passed 2025-10-31 03:07:38,150 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:07:38,151 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-31 03:07:38,151 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:07:38,151 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38934700 passed 2025-10-31 03:07:43,203 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:07:43,203 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:07:43,203 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:07:43,203 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29449313 passed 2025-10-31 03:07:48,261 - DEBUG - [Pod ctest-pod-41120826] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 03:07:48,261 - DEBUG - [Pod Pod ctest-pod-41120826] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 03:07:48,261 - DEBUG - [Pod Pod ctest-pod-41120826] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-31 03:07:48,261 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41120826 passed 2025-10-31 03:07:48,270 - INFO - Updating Network Policy ingress-on-service 2025-10-31 03:07:53,351 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:53,351 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:53,351 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:58,404 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:58,404 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:07:58,404 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:03,462 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:03,462 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:03,462 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:08,519 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:08,519 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:08,519 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:13,590 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:13,590 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:13,590 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:18,636 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:18,636 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:18,636 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:23,698 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:23,698 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:23,698 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:28,754 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:28,754 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:28,754 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:33,814 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:33,815 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:33,815 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:38,870 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:38,871 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:38,871 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.108.243.34:80 (10.108.243.34:80) wget: download timed out 2025-10-31 03:08:38,871 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81757709': 0, 'ctest-pod-21733849': 0} 2025-10-31 03:08:38,923 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:38,923 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:08:38,923 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:38,983 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:38,983 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:08:38,983 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:38,983 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81757709': 1, 'ctest-pod-21733849': 1} 2025-10-31 03:08:39,036 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:39,037 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:08:39,037 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: ctest-pod-21733849 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:39,092 - DEBUG - [Pod ctest-pod-48040407] Cmd: wget http://10.108.243.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:39,092 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd wget http://10.108.243.34:80/ -O - -T 5 -t 1 passed 2025-10-31 03:08:39,092 - DEBUG - [Pod Pod ctest-pod-48040407] Cmd output: ctest-pod-81757709 Connecting to 10.108.243.34:80 (10.108.243.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-31 03:08:39,092 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81757709': 1, 'ctest-pod-21733849': 1} 2025-10-31 03:08:41,146 - DEBUG - [Pod ctest-pod-38934700] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.446 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.122 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.216/0.446 ms 2025-10-31 03:08:41,146 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-38934700 with expectation True passed 2025-10-31 03:08:43,199 - DEBUG - [Pod ctest-pod-29449313] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.586 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.257/0.586 ms 2025-10-31 03:08:43,199 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29449313 with expectation True passed 2025-10-31 03:08:45,250 - DEBUG - [Pod ctest-pod-48040407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.373 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.516/1.373 ms 2025-10-31 03:08:45,251 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48040407 with expectation True passed 2025-10-31 03:08:45,307 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:45,307 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 03:08:45,307 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:45,307 - INFO - wget check of of http://10.47.255.251 from ctest-pod-38934700 passed 2025-10-31 03:08:45,366 - DEBUG - [Pod ctest-pod-38934700] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:45,366 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-31 03:08:45,366 - DEBUG - [Pod Pod ctest-pod-38934700] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:45,367 - INFO - wget check of of http://10.47.255.250 from ctest-pod-38934700 passed 2025-10-31 03:08:50,426 - DEBUG - [Pod ctest-pod-29449313] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:08:50,426 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:08:50,426 - DEBUG - [Pod Pod ctest-pod-29449313] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-31 03:08:50,426 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29449313 passed 2025-10-31 03:08:50,488 - DEBUG - [Pod ctest-pod-41120826] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:50,488 - DEBUG - [Pod Pod ctest-pod-41120826] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-31 03:08:50,488 - DEBUG - [Pod Pod ctest-pod-41120826] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-31 03:08:50,488 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41120826 passed 2025-10-31 03:08:50,488 - INFO - Deleting Network Policy : ingress-on-service 2025-10-31 03:08:50,489 - INFO - Deleting service : ctest-nginx-svc-36510157 2025-10-31 03:08:50,760 - DEBUG - No XMPP flaps were noticed during the test 2025-10-31 03:08:50,760 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-10-31 03:08:50,761 - INFO - -------------------------------------------------------------------------------- 2025-10-31 03:08:50,765 - INFO - Deleting pod ctest-new-default-22455336:ctest-pod-81757709 2025-10-31 03:08:50,766 - INFO - Deleting pod ctest-new-default-22455336:ctest-pod-21733849 2025-10-31 03:08:50,766 - INFO - Deleting pod ctest-non-default-17824071:ctest-pod-21574294 2025-10-31 03:08:50,767 - INFO - Deleting pod ctest-non-default-17824071:ctest-pod-17054267 2025-10-31 03:08:50,767 - INFO - Deleting pod ctest-new-default-22455336:ctest-pod-29449313 2025-10-31 03:08:50,768 - INFO - Deleting pod ctest-new-default-22455336:ctest-pod-38934700 2025-10-31 03:08:50,768 - INFO - Deleting pod ctest-non-default-17824071:ctest-pod-48040407 2025-10-31 03:08:50,769 - INFO - Deleting pod ctest-non-default-17824071:ctest-pod-41120826 2025-10-31 03:08:50,910 - WARNING - Pod uuid 198075a1-eef7-445b-87f6-bfc51d96e3e4 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,910 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,910 - WARNING - Pod uuid f5132cf4-4a3d-4260-9982-7f3e851a1558 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,912 - WARNING - Pod uuid 343ffa84-9c8e-4175-af50-e6804618eec8 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,912 - WARNING - Pod uuid 57301788-41ce-4184-947b-d1df9d01a5a7 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,912 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,914 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:50,914 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:55,948 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:55,949 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:55,951 - DEBUG - Pod 57301788-41ce-4184-947b-d1df9d01a5a7 is not in agent 10.0.0.23 VM list 2025-10-31 03:08:55,952 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:55,953 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:08:55,953 - DEBUG - Pod 343ffa84-9c8e-4175-af50-e6804618eec8 is not in agent 10.0.0.23 VM list 2025-10-31 03:08:55,955 - DEBUG - Pod 198075a1-eef7-445b-87f6-bfc51d96e3e4 is not in agent 10.0.0.23 VM list 2025-10-31 03:08:55,956 - DEBUG - Pod f5132cf4-4a3d-4260-9982-7f3e851a1558 is not in agent 10.0.0.23 VM list 2025-10-31 03:08:55,974 - DEBUG - VMI 6c9059c8-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:08:55,974 - INFO - Verified that pod ctest-pod-81757709 is removed in agent 2025-10-31 03:08:55,974 - DEBUG - VMI 6dad4d2a-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:08:55,975 - INFO - Verified that pod ctest-pod-21574294 is removed in agent 2025-10-31 03:08:55,976 - DEBUG - VMI 6d0bfd3a-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:08:55,976 - INFO - Verified that pod ctest-pod-21733849 is removed in agent 2025-10-31 03:08:55,976 - DEBUG - VMI 6e265e5e-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:08:55,976 - INFO - Verified that pod ctest-pod-17054267 is removed in agent 2025-10-31 03:09:00,963 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:00,964 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:00,966 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:00,966 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:05,983 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:05,984 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:05,986 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:05,986 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:11,013 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:11,019 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:11,020 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:11,020 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:16,022 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:16,035 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:16,036 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:16,037 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:21,052 - WARNING - Pod uuid 5659881d-8292-4113-8c97-75e72aff3643 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:21,052 - WARNING - Pod uuid 142c3445-3618-4b32-a8b8-f0cb76c8df99 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:21,054 - WARNING - Pod uuid 49e04ee0-afc6-4889-96a8-02128d83ad7c is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:21,054 - WARNING - Pod uuid e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is still seen in agent 10.0.0.23 VM list 2025-10-31 03:09:26,069 - DEBUG - Pod 142c3445-3618-4b32-a8b8-f0cb76c8df99 is not in agent 10.0.0.23 VM list 2025-10-31 03:09:26,070 - DEBUG - Pod e6340b53-46c1-4dfb-9f8c-0147bacee3f3 is not in agent 10.0.0.23 VM list 2025-10-31 03:09:26,071 - DEBUG - Pod 5659881d-8292-4113-8c97-75e72aff3643 is not in agent 10.0.0.23 VM list 2025-10-31 03:09:26,074 - DEBUG - Pod 49e04ee0-afc6-4889-96a8-02128d83ad7c is not in agent 10.0.0.23 VM list 2025-10-31 03:09:26,084 - DEBUG - VMI 6eb2fb16-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:09:26,084 - INFO - Verified that pod ctest-pod-29449313 is removed in agent 2025-10-31 03:09:26,086 - DEBUG - VMI 6f9c68b4-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:09:26,086 - INFO - Verified that pod ctest-pod-48040407 is removed in agent 2025-10-31 03:09:26,087 - DEBUG - VMI 7010301e-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:09:26,087 - INFO - Verified that pod ctest-pod-41120826 is removed in agent 2025-10-31 03:09:26,087 - DEBUG - VMI 6f266254-b606-11f0-bb1a-fa163e479cb1 is removed from agent 10.0.0.23 2025-10-31 03:09:26,087 - INFO - Verified that pod ctest-pod-38934700 is removed in agent 2025-10-31 03:09:26,087 - INFO - Deleting namespace ctest-non-default-17824071 2025-10-31 03:09:26,102 - DEBUG - Namespace ctest-non-default-17824071 still in k8s 2025-10-31 03:09:28,107 - DEBUG - Namespace ctest-non-default-17824071 still in k8s 2025-10-31 03:09:30,112 - DEBUG - Namespace ctest-non-default-17824071 still in k8s 2025-10-31 03:09:32,117 - DEBUG - Namespace ctest-non-default-17824071 is not in k8s 2025-10-31 03:09:32,117 - DEBUG - No need to check project deletion in contrail-api 2025-10-31 03:09:32,117 - INFO - Deleting namespace ctest-new-default-22455336 2025-10-31 03:09:32,126 - DEBUG - Namespace ctest-new-default-22455336 still in k8s 2025-10-31 03:09:34,131 - DEBUG - Namespace ctest-new-default-22455336 still in k8s 2025-10-31 03:09:36,146 - DEBUG - Namespace ctest-new-default-22455336 still in k8s 2025-10-31 03:09:38,151 - DEBUG - Namespace ctest-new-default-22455336 is not in k8s 2025-10-31 03:09:38,151 - DEBUG - No need to check project deletion in contrail-api