2025-09-11 01:31:51,635 - INFO - Using existing project ['default-domain', 'k8s-default'](5490721c-7da6-47c5-88d4-547be86cc421) 2025-09-11 01:31:51,657 - DEBUG - Namespace ctest-new-default-12287021 not present 2025-09-11 01:31:51,663 - INFO - Created namespace ctest-new-default-12287021 2025-09-11 01:31:54,669 - DEBUG - Namespace ctest-non-default-80248102 not present 2025-09-11 01:31:54,678 - INFO - Created namespace ctest-non-default-80248102 2025-09-11 01:31:57,696 - DEBUG - Pod ctest-pod-15334523 not present 2025-09-11 01:31:57,697 - INFO - Creating Pod ctest-pod-15334523 2025-09-11 01:31:57,718 - DEBUG - Pod : ctest-pod-15334523 UUID is e31ee588-ae66-4ff0-b19d-d66cba0c8fae 2025-09-11 01:31:57,724 - DEBUG - Pod ctest-pod-36012266 not present 2025-09-11 01:31:57,724 - INFO - Creating Pod ctest-pod-36012266 2025-09-11 01:31:57,744 - DEBUG - Pod : ctest-pod-36012266 UUID is 1b0d31d8-4229-4b0f-b705-01f586cebb10 2025-09-11 01:31:57,748 - DEBUG - Pod ctest-pod-74770723 not present 2025-09-11 01:31:57,749 - INFO - Creating Pod ctest-pod-74770723 2025-09-11 01:31:57,771 - DEBUG - Pod : ctest-pod-74770723 UUID is 1c91ad5c-b338-471d-b016-f4cd94290a9d 2025-09-11 01:31:57,776 - DEBUG - Pod ctest-pod-90488616 not present 2025-09-11 01:31:57,777 - INFO - Creating Pod ctest-pod-90488616 2025-09-11 01:31:57,798 - DEBUG - Pod : ctest-pod-90488616 UUID is d358617c-6b18-48db-ad8b-2cf108223514 2025-09-11 01:31:57,804 - DEBUG - Pod ctest-pod-80735494 not present 2025-09-11 01:31:57,804 - INFO - Creating Pod ctest-pod-80735494 2025-09-11 01:31:57,824 - DEBUG - Pod : ctest-pod-80735494 UUID is 6b260ff5-3186-415e-957b-61449dcc5ef2 2025-09-11 01:31:57,830 - DEBUG - Pod ctest-pod-94279551 not present 2025-09-11 01:31:57,830 - INFO - Creating Pod ctest-pod-94279551 2025-09-11 01:31:57,855 - DEBUG - Pod : ctest-pod-94279551 UUID is 3c042592-f182-415e-826a-918174a2437d 2025-09-11 01:31:57,859 - DEBUG - Pod ctest-pod-49853575 not present 2025-09-11 01:31:57,860 - INFO - Creating Pod ctest-pod-49853575 2025-09-11 01:31:57,891 - DEBUG - Pod : ctest-pod-49853575 UUID is 814607b0-d870-4ebe-9e5d-ba9e08ee18eb 2025-09-11 01:31:57,895 - DEBUG - Pod ctest-pod-37672324 not present 2025-09-11 01:31:57,896 - INFO - Creating Pod ctest-pod-37672324 2025-09-11 01:31:57,921 - DEBUG - Pod : ctest-pod-37672324 UUID is 970e942e-057c-4cc9-a99a-2ebc94b8f32a 2025-09-11 01:31:58,204 - INFO - Project default-domain:k8s-ctest-new-default-12287021 for Namespace ctest-new-default-12287021 is seen in contrail-api 2025-09-11 01:31:58,204 - DEBUG - Project uuid in Contrail is 60f6ad6d-d839-400f-ac64-8e00f0216e74 2025-09-11 01:31:58,355 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=e9674b09-bc14-4ee0-9cb7-7034a39afcdf 2025-09-11 01:31:58,359 - INFO - Namespace ctest-new-default-12287021 with uuid e9674b09-bc14-4ee0-9cb7-7034a39afcdf found in kube manager 2025-09-11 01:31:58,359 - INFO - Namespace ctest-new-default-12287021 verification passed 2025-09-11 01:31:58,737 - INFO - Project default-domain:k8s-ctest-non-default-80248102 for Namespace ctest-non-default-80248102 is seen in contrail-api 2025-09-11 01:31:58,738 - DEBUG - Project uuid in Contrail is 9c7298bb-c3d6-4cf5-8137-0ae0b0c43179 2025-09-11 01:31:58,738 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=ca3e25a1-dbed-409d-ad36-019119e9f320 2025-09-11 01:31:58,741 - INFO - Namespace ctest-non-default-80248102 with uuid ca3e25a1-dbed-409d-ad36-019119e9f320 found in kube manager 2025-09-11 01:31:58,741 - INFO - Namespace ctest-non-default-80248102 verification passed 2025-09-11 01:31:58,794 - DEBUG - Pod ctest-pod-15334523 not in running state.Currently in Pending 2025-09-11 01:32:03,802 - DEBUG - Pod ctest-pod-15334523 not in running state.Currently in Pending 2025-09-11 01:32:08,809 - DEBUG - Pod ctest-pod-15334523 not in running state.Currently in Pending 2025-09-11 01:32:13,817 - INFO - Pod ctest-pod-15334523 is in running state.Got IP 10.47.255.250 2025-09-11 01:32:13,868 - DEBUG - Pod ctest-pod-15334523 has vmi 1d364f82-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:13,868 - INFO - Verified pod ctest-pod-15334523 in contrail-api 2025-09-11 01:32:13,878 - DEBUG - VMI 1d364f82-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:13,878 - INFO - Verified Pod ctest-pod-15334523 in agent 10.0.0.48 2025-09-11 01:32:13,878 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=e31ee588-ae66-4ff0-b19d-d66cba0c8fae 2025-09-11 01:32:13,882 - INFO - Pod ctest-pod-15334523 with uuid e31ee588-ae66-4ff0-b19d-d66cba0c8fae found in kube manager 2025-09-11 01:32:13,882 - INFO - Pod ctest-pod-15334523 verification passed 2025-09-11 01:32:13,889 - INFO - Pod ctest-pod-36012266 is in running state.Got IP 10.47.255.249 2025-09-11 01:32:13,981 - DEBUG - Pod ctest-pod-36012266 has vmi 1de53a9c-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:13,981 - INFO - Verified pod ctest-pod-36012266 in contrail-api 2025-09-11 01:32:13,990 - DEBUG - VMI 1de53a9c-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:13,990 - INFO - Verified Pod ctest-pod-36012266 in agent 10.0.0.48 2025-09-11 01:32:13,990 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1b0d31d8-4229-4b0f-b705-01f586cebb10 2025-09-11 01:32:13,994 - INFO - Pod ctest-pod-36012266 with uuid 1b0d31d8-4229-4b0f-b705-01f586cebb10 found in kube manager 2025-09-11 01:32:13,994 - INFO - Pod ctest-pod-36012266 verification passed 2025-09-11 01:32:14,000 - INFO - Pod ctest-pod-74770723 is in running state.Got IP 10.47.255.248 2025-09-11 01:32:14,093 - DEBUG - Pod ctest-pod-74770723 has vmi 1ee26d3e-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:14,093 - INFO - Verified pod ctest-pod-74770723 in contrail-api 2025-09-11 01:32:14,102 - DEBUG - VMI 1ee26d3e-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:14,102 - INFO - Verified Pod ctest-pod-74770723 in agent 10.0.0.48 2025-09-11 01:32:14,102 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1c91ad5c-b338-471d-b016-f4cd94290a9d 2025-09-11 01:32:14,105 - INFO - Pod ctest-pod-74770723 with uuid 1c91ad5c-b338-471d-b016-f4cd94290a9d found in kube manager 2025-09-11 01:32:14,105 - INFO - Pod ctest-pod-74770723 verification passed 2025-09-11 01:32:14,112 - INFO - Pod ctest-pod-90488616 is in running state.Got IP 10.47.255.247 2025-09-11 01:32:14,205 - DEBUG - Pod ctest-pod-90488616 has vmi 1f90c50a-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:14,205 - INFO - Verified pod ctest-pod-90488616 in contrail-api 2025-09-11 01:32:14,213 - DEBUG - VMI 1f90c50a-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:14,213 - INFO - Verified Pod ctest-pod-90488616 in agent 10.0.0.48 2025-09-11 01:32:14,213 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=d358617c-6b18-48db-ad8b-2cf108223514 2025-09-11 01:32:14,216 - INFO - Pod ctest-pod-90488616 with uuid d358617c-6b18-48db-ad8b-2cf108223514 found in kube manager 2025-09-11 01:32:14,216 - INFO - Pod ctest-pod-90488616 verification passed 2025-09-11 01:32:14,223 - DEBUG - Pod ctest-pod-80735494 not in running state.Currently in Pending 2025-09-11 01:32:19,230 - INFO - Pod ctest-pod-80735494 is in running state.Got IP 10.47.255.246 2025-09-11 01:32:19,280 - DEBUG - Pod ctest-pod-80735494 has vmi 2061a45e-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:19,280 - INFO - Verified pod ctest-pod-80735494 in contrail-api 2025-09-11 01:32:19,290 - DEBUG - VMI 2061a45e-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:19,290 - INFO - Verified Pod ctest-pod-80735494 in agent 10.0.0.48 2025-09-11 01:32:19,291 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6b260ff5-3186-415e-957b-61449dcc5ef2 2025-09-11 01:32:19,294 - INFO - Pod ctest-pod-80735494 with uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 found in kube manager 2025-09-11 01:32:19,294 - INFO - Pod ctest-pod-80735494 verification passed 2025-09-11 01:32:19,299 - INFO - Pod ctest-pod-49853575 is in running state.Got IP 10.47.255.244 2025-09-11 01:32:19,390 - DEBUG - Pod ctest-pod-49853575 has vmi 21de208c-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:19,391 - INFO - Verified pod ctest-pod-49853575 in contrail-api 2025-09-11 01:32:19,399 - DEBUG - VMI 21de208c-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:19,399 - INFO - Verified Pod ctest-pod-49853575 in agent 10.0.0.48 2025-09-11 01:32:19,399 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=814607b0-d870-4ebe-9e5d-ba9e08ee18eb 2025-09-11 01:32:19,402 - INFO - Pod ctest-pod-49853575 with uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb found in kube manager 2025-09-11 01:32:19,402 - INFO - Pod ctest-pod-49853575 verification passed 2025-09-11 01:32:19,408 - INFO - Pod ctest-pod-94279551 is in running state.Got IP 10.47.255.245 2025-09-11 01:32:19,499 - DEBUG - Pod ctest-pod-94279551 has vmi 211df032-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:19,500 - INFO - Verified pod ctest-pod-94279551 in contrail-api 2025-09-11 01:32:19,512 - DEBUG - VMI 211df032-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:19,512 - INFO - Verified Pod ctest-pod-94279551 in agent 10.0.0.48 2025-09-11 01:32:19,512 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=3c042592-f182-415e-826a-918174a2437d 2025-09-11 01:32:19,517 - INFO - Pod ctest-pod-94279551 with uuid 3c042592-f182-415e-826a-918174a2437d found in kube manager 2025-09-11 01:32:19,517 - INFO - Pod ctest-pod-94279551 verification passed 2025-09-11 01:32:19,526 - DEBUG - Pod ctest-pod-37672324 not in running state.Currently in Pending 2025-09-11 01:32:24,534 - INFO - Pod ctest-pod-37672324 is in running state.Got IP 10.47.255.243 2025-09-11 01:32:24,585 - DEBUG - Pod ctest-pod-37672324 has vmi 22b4efcc-8eaf-11f0-ae6a-02422aeb1519 2025-09-11 01:32:24,586 - INFO - Verified pod ctest-pod-37672324 in contrail-api 2025-09-11 01:32:24,595 - DEBUG - VMI 22b4efcc-8eaf-11f0-ae6a-02422aeb1519 is active in agent 10.0.0.48 2025-09-11 01:32:24,595 - INFO - Verified Pod ctest-pod-37672324 in agent 10.0.0.48 2025-09-11 01:32:24,595 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=970e942e-057c-4cc9-a99a-2ebc94b8f32a 2025-09-11 01:32:24,598 - INFO - Pod ctest-pod-37672324 with uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a found in kube manager 2025-09-11 01:32:24,598 - INFO - Pod ctest-pod-37672324 verification passed 2025-09-11 01:32:24,598 - INFO - ================================================================================ 2025-09-11 01:32:24,598 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-11 01:32:24,598 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-11 01:32:24,844 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with 2025-09-11 01:32:24,844 - INFO - Initial checks done. Running the testcase now 2025-09-11 01:32:24,844 - INFO - 2025-09-11 01:32:24,918 - DEBUG - [Pod ctest-pod-15334523] Cmd: echo ctest-pod-15334523 > /usr/share/nginx/html/index.html, Output: 2025-09-11 01:32:24,999 - DEBUG - [Pod ctest-pod-36012266] Cmd: echo ctest-pod-36012266 > /usr/share/nginx/html/index.html, Output: 2025-09-11 01:32:25,064 - DEBUG - [Pod ctest-pod-74770723] Cmd: echo ctest-pod-74770723 > /usr/share/nginx/html/index.html, Output: 2025-09-11 01:32:25,122 - DEBUG - [Pod ctest-pod-90488616] Cmd: echo ctest-pod-90488616 > /usr/share/nginx/html/index.html, Output: 2025-09-11 01:32:25,126 - DEBUG - Service ctest-nginx-svc-35839358 not present 2025-09-11 01:32:25,126 - INFO - Creating service ctest-nginx-svc-35839358 2025-09-11 01:32:25,142 - INFO - Created Service ctest-nginx-svc-35839358 2025-09-11 01:32:25,148 - WARNING - Service UUID 731446c3-cc3d-4b93-9bea-d30c201f647e not yet found in contrail-api 2025-09-11 01:32:26,153 - INFO - Validated that Service ctest-nginx-svc-35839358 is seen in contrail-api 2025-09-11 01:32:26,153 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=731446c3-cc3d-4b93-9bea-d30c201f647e 2025-09-11 01:32:26,156 - INFO - Service ctest-nginx-svc-35839358 with uuid 731446c3-cc3d-4b93-9bea-d30c201f647e found in kube manager 2025-09-11 01:32:26,156 - INFO - Service ctest-nginx-svc-35839358 verification passed 2025-09-11 01:32:27,267 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-36012266 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,267 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:32:27,267 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-36012266 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,340 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:32:27,340 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:32:27,340 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:32:27,340 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15334523': 1, 'ctest-pod-36012266': 1} 2025-09-11 01:32:27,405 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,405 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:32:27,405 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,466 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36012266 2025-09-11 01:32:27,467 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:32:27,467 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-36012266 2025-09-11 01:32:27,528 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,529 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:32:27,529 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:32:27,529 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15334523': 1, 'ctest-pod-36012266': 2} 2025-09-11 01:32:27,532 - DEBUG - Network policy ingress-on-service not present 2025-09-11 01:32:27,533 - INFO - Creating Network Policy ingress-on-service 2025-09-11 01:32:27,543 - INFO - Network policy found in k8s 2025-09-11 01:32:27,543 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1488ec78-6738-4677-af9d-07769f69f4ee 2025-09-11 01:32:27,547 - INFO - Network Policy ingress-on-service with uuid 1488ec78-6738-4677-af9d-07769f69f4ee found in kube manager 2025-09-11 01:32:27,567 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-11 01:32:27,567 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-11 01:32:27,567 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1488ec78-6738-4677-af9d-07769f69f4ee 2025-09-11 01:32:27,585 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-11 01:32:29,586 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1488ec78-6738-4677-af9d-07769f69f4ee 2025-09-11 01:32:29,605 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-11 01:32:31,606 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1488ec78-6738-4677-af9d-07769f69f4ee 2025-09-11 01:32:31,627 - INFO - Network policy with name ingress-on-service found in agent 2025-09-11 01:32:31,627 - INFO - Network Policy ingress-on-service verification passed 2025-09-11 01:32:36,696 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:36,696 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:36,696 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:41,759 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:41,759 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:41,759 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:46,825 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:46,825 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:46,826 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:51,889 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:51,889 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:51,889 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:56,962 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:56,962 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:32:56,962 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:02,030 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:02,030 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:02,030 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:07,096 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:07,097 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:07,097 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:12,170 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:12,170 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:12,170 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:17,235 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:17,235 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:17,235 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:22,293 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:22,293 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:22,293 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:22,293 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15334523': 0, 'ctest-pod-36012266': 0} 2025-09-11 01:33:22,353 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,353 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,353 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,425 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-15334523 Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,425 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,425 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: ctest-pod-15334523 Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,506 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:33:22,506 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,506 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:33:22,567 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,568 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,568 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,640 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-15334523 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,640 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,640 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-15334523 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,700 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,701 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:33:22,701 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:33:22,701 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15334523': 5, 'ctest-pod-36012266': 1} 2025-09-11 01:33:27,759 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:27,760 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:27,760 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:32,823 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:32,823 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:32,823 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:37,881 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:37,881 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:37,881 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:42,953 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:42,954 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:42,954 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:48,032 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:48,032 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:48,032 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:53,104 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:53,105 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:53,105 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:58,168 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:58,168 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:33:58,168 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:03,243 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:03,244 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:03,244 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:08,305 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:08,305 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:08,305 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:13,367 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:13,367 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:13,367 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:13,367 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15334523': 0, 'ctest-pod-36012266': 0} 2025-09-11 01:34:15,444 - DEBUG - [Pod ctest-pod-94279551] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.497 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.226/0.497 ms 2025-09-11 01:34:15,444 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94279551 with expectation True passed 2025-09-11 01:34:17,512 - DEBUG - [Pod ctest-pod-80735494] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.877 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.104 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.351/0.877 ms 2025-09-11 01:34:17,512 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-80735494 with expectation True passed 2025-09-11 01:34:19,585 - DEBUG - [Pod ctest-pod-49853575] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.658 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.069 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.604/1.658 ms 2025-09-11 01:34:19,586 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-49853575 with expectation True passed 2025-09-11 01:34:19,651 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:34:19,651 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-11 01:34:19,651 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:34:19,651 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94279551 passed 2025-09-11 01:34:19,726 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:34:19,727 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-09-11 01:34:19,727 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:34:19,727 - INFO - wget check of of http://10.47.255.249 from ctest-pod-94279551 passed 2025-09-11 01:34:24,785 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:34:24,786 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:34:24,786 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:34:24,786 - INFO - wget check of of http://10.47.255.249 from ctest-pod-80735494 passed 2025-09-11 01:34:29,856 - DEBUG - [Pod ctest-pod-37672324] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 01:34:29,856 - DEBUG - [Pod Pod ctest-pod-37672324] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 01:34:29,856 - DEBUG - [Pod Pod ctest-pod-37672324] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 01:34:29,856 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37672324 passed 2025-09-11 01:34:29,869 - INFO - Updating Network Policy ingress-on-service 2025-09-11 01:34:34,970 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:34,970 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:34,970 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:40,029 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:40,029 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:40,029 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:45,101 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:45,101 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:45,101 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:50,170 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:50,170 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:50,170 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:55,232 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:55,232 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:34:55,232 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:00,303 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:00,303 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:00,303 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:05,371 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:05,372 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:05,372 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:10,439 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:10,439 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:10,439 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:15,499 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:15,500 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:15,500 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:20,567 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:20,568 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:20,568 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) wget: download timed out 2025-09-11 01:35:20,568 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15334523': 0, 'ctest-pod-36012266': 0} 2025-09-11 01:35:20,646 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-36012266 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,646 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:20,646 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout ctest-pod-36012266 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,719 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,719 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:20,719 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,782 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,782 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:20,782 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,855 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: ctest-pod-15334523 Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,855 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:20,855 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: ctest-pod-15334523 Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,855 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15334523': 1, 'ctest-pod-36012266': 3} 2025-09-11 01:35:20,922 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:20,922 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:20,922 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,015 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,015 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:21,015 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,083 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:35:21,083 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:21,083 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15334523 2025-09-11 01:35:21,149 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,150 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:21,150 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-15334523 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,206 - DEBUG - [Pod ctest-pod-49853575] Cmd: wget http://10.111.252.252:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,206 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd wget http://10.111.252.252:80/ -O - -T 5 -t 1 passed 2025-09-11 01:35:21,206 - DEBUG - [Pod Pod ctest-pod-49853575] Cmd output: Connecting to 10.111.252.252:80 (10.111.252.252:80) ctest-pod-36012266 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 01:35:21,207 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15334523': 4, 'ctest-pod-36012266': 1} 2025-09-11 01:35:23,263 - DEBUG - [Pod ctest-pod-94279551] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.341 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.125 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.098/0.188/0.341 ms 2025-09-11 01:35:23,263 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94279551 with expectation True passed 2025-09-11 01:35:25,331 - DEBUG - [Pod ctest-pod-80735494] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.493 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.118 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.234/0.493 ms 2025-09-11 01:35:25,331 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-80735494 with expectation True passed 2025-09-11 01:35:27,400 - DEBUG - [Pod ctest-pod-49853575] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.620 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.072 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.254/0.620 ms 2025-09-11 01:35:27,400 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-49853575 with expectation True passed 2025-09-11 01:35:27,472 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:27,472 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-11 01:35:27,472 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:27,472 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94279551 passed 2025-09-11 01:35:27,537 - DEBUG - [Pod ctest-pod-94279551] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:27,538 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-09-11 01:35:27,538 - DEBUG - [Pod Pod ctest-pod-94279551] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:27,538 - INFO - wget check of of http://10.47.255.249 from ctest-pod-94279551 passed 2025-09-11 01:35:32,603 - DEBUG - [Pod ctest-pod-80735494] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:35:32,603 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:35:32,603 - DEBUG - [Pod Pod ctest-pod-80735494] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-09-11 01:35:32,603 - INFO - wget check of of http://10.47.255.249 from ctest-pod-80735494 passed 2025-09-11 01:35:32,665 - DEBUG - [Pod ctest-pod-37672324] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:32,665 - DEBUG - [Pod Pod ctest-pod-37672324] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-11 01:35:32,665 - DEBUG - [Pod Pod ctest-pod-37672324] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 01:35:32,665 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37672324 passed 2025-09-11 01:35:32,665 - INFO - Deleting Network Policy : ingress-on-service 2025-09-11 01:35:32,667 - INFO - Deleting service : ctest-nginx-svc-35839358 2025-09-11 01:35:33,180 - DEBUG - No XMPP flaps were noticed during the test 2025-09-11 01:35:33,180 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09] 2025-09-11 01:35:33,180 - INFO - -------------------------------------------------------------------------------- 2025-09-11 01:35:33,184 - INFO - Deleting pod ctest-new-default-12287021:ctest-pod-15334523 2025-09-11 01:35:33,184 - INFO - Deleting pod ctest-new-default-12287021:ctest-pod-36012266 2025-09-11 01:35:33,185 - INFO - Deleting pod ctest-non-default-80248102:ctest-pod-74770723 2025-09-11 01:35:33,185 - INFO - Deleting pod ctest-non-default-80248102:ctest-pod-90488616 2025-09-11 01:35:33,185 - INFO - Deleting pod ctest-new-default-12287021:ctest-pod-80735494 2025-09-11 01:35:33,186 - INFO - Deleting pod ctest-new-default-12287021:ctest-pod-94279551 2025-09-11 01:35:33,186 - INFO - Deleting pod ctest-non-default-80248102:ctest-pod-49853575 2025-09-11 01:35:33,186 - INFO - Deleting pod ctest-non-default-80248102:ctest-pod-37672324 2025-09-11 01:35:33,287 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,287 - WARNING - Pod uuid e31ee588-ae66-4ff0-b19d-d66cba0c8fae is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,288 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,288 - WARNING - Pod uuid 1c91ad5c-b338-471d-b016-f4cd94290a9d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,289 - WARNING - Pod uuid d358617c-6b18-48db-ad8b-2cf108223514 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,293 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,293 - WARNING - Pod uuid 1b0d31d8-4229-4b0f-b705-01f586cebb10 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:33,293 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:38,311 - DEBUG - Pod 1b0d31d8-4229-4b0f-b705-01f586cebb10 is not in agent 10.0.0.48 VM list 2025-09-11 01:35:38,312 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:38,312 - DEBUG - Pod e31ee588-ae66-4ff0-b19d-d66cba0c8fae is not in agent 10.0.0.48 VM list 2025-09-11 01:35:38,313 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:38,313 - DEBUG - Pod 1c91ad5c-b338-471d-b016-f4cd94290a9d is not in agent 10.0.0.48 VM list 2025-09-11 01:35:38,314 - DEBUG - Pod d358617c-6b18-48db-ad8b-2cf108223514 is not in agent 10.0.0.48 VM list 2025-09-11 01:35:38,315 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:38,316 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:38,325 - DEBUG - VMI 1f90c50a-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:35:38,325 - INFO - Verified that pod ctest-pod-90488616 is removed in agent 2025-09-11 01:35:38,326 - DEBUG - VMI 1ee26d3e-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:35:38,326 - INFO - Verified that pod ctest-pod-74770723 is removed in agent 2025-09-11 01:35:38,326 - DEBUG - VMI 1d364f82-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:35:38,326 - INFO - Verified that pod ctest-pod-15334523 is removed in agent 2025-09-11 01:35:38,326 - DEBUG - VMI 1de53a9c-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:35:38,326 - INFO - Verified that pod ctest-pod-36012266 is removed in agent 2025-09-11 01:35:43,324 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:43,324 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:43,325 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:43,325 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:48,343 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:48,343 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:48,344 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:48,345 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:53,361 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:53,362 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:53,364 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:53,365 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:58,374 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:58,375 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:58,376 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:35:58,376 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:36:03,392 - WARNING - Pod uuid 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is still seen in agent 10.0.0.48 VM list 2025-09-11 01:36:03,392 - WARNING - Pod uuid 6b260ff5-3186-415e-957b-61449dcc5ef2 is still seen in agent 10.0.0.48 VM list 2025-09-11 01:36:03,394 - WARNING - Pod uuid 3c042592-f182-415e-826a-918174a2437d is still seen in agent 10.0.0.48 VM list 2025-09-11 01:36:03,394 - WARNING - Pod uuid 970e942e-057c-4cc9-a99a-2ebc94b8f32a is still seen in agent 10.0.0.48 VM list 2025-09-11 01:36:08,406 - DEBUG - Pod 3c042592-f182-415e-826a-918174a2437d is not in agent 10.0.0.48 VM list 2025-09-11 01:36:08,407 - DEBUG - Pod 970e942e-057c-4cc9-a99a-2ebc94b8f32a is not in agent 10.0.0.48 VM list 2025-09-11 01:36:08,408 - DEBUG - Pod 6b260ff5-3186-415e-957b-61449dcc5ef2 is not in agent 10.0.0.48 VM list 2025-09-11 01:36:08,409 - DEBUG - Pod 814607b0-d870-4ebe-9e5d-ba9e08ee18eb is not in agent 10.0.0.48 VM list 2025-09-11 01:36:08,423 - DEBUG - VMI 2061a45e-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:36:08,423 - INFO - Verified that pod ctest-pod-80735494 is removed in agent 2025-09-11 01:36:08,423 - DEBUG - VMI 22b4efcc-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:36:08,423 - INFO - Verified that pod ctest-pod-37672324 is removed in agent 2025-09-11 01:36:08,424 - DEBUG - VMI 21de208c-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:36:08,424 - INFO - Verified that pod ctest-pod-49853575 is removed in agent 2025-09-11 01:36:08,424 - DEBUG - VMI 211df032-8eaf-11f0-ae6a-02422aeb1519 is removed from agent 10.0.0.48 2025-09-11 01:36:08,424 - INFO - Verified that pod ctest-pod-94279551 is removed in agent 2025-09-11 01:36:08,424 - INFO - Deleting namespace ctest-non-default-80248102 2025-09-11 01:36:08,436 - DEBUG - Namespace ctest-non-default-80248102 still in k8s 2025-09-11 01:36:10,442 - DEBUG - Namespace ctest-non-default-80248102 still in k8s 2025-09-11 01:36:12,449 - DEBUG - Namespace ctest-non-default-80248102 still in k8s 2025-09-11 01:36:14,454 - DEBUG - Namespace ctest-non-default-80248102 is not in k8s 2025-09-11 01:36:14,455 - DEBUG - No need to check project deletion in contrail-api 2025-09-11 01:36:14,455 - INFO - Deleting namespace ctest-new-default-12287021 2025-09-11 01:36:14,467 - DEBUG - Namespace ctest-new-default-12287021 still in k8s 2025-09-11 01:36:16,472 - DEBUG - Namespace ctest-new-default-12287021 still in k8s 2025-09-11 01:36:18,477 - DEBUG - Namespace ctest-new-default-12287021 still in k8s 2025-09-11 01:36:20,482 - DEBUG - Namespace ctest-new-default-12287021 is not in k8s 2025-09-11 01:36:20,482 - DEBUG - No need to check project deletion in contrail-api